-- Logs begin at Wed 2022-07-27 18:09:37 UTC, end at Wed 2022-07-27 19:35:45 UTC. -- Jul 27 19:08:19.852708 dv-osbrick-849020-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 19:08:19.865708 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 19:08:19.868694 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 19:08:19 2022] *** Jul 27 19:08:19.868876 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 19:08:19.868985 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 19:08:19.869097 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: nodename: dv-osbrick-849020-4-ceph Jul 27 19:08:19.869202 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: machine: x86_64 Jul 27 19:08:19.869316 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: clock source: unix Jul 27 19:08:19.869413 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: pcre jit disabled Jul 27 19:08:19.869952 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: detected number of CPU cores: 4 Jul 27 19:08:19.870062 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: current working directory: / Jul 27 19:08:19.870174 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: detected binary path: /usr/bin/uwsgi-core Jul 27 19:08:19.870286 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: your processes number limit is 47680 Jul 27 19:08:19.870392 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: your memory page size is 4096 bytes Jul 27 19:08:19.870503 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: detected max file descriptor number: 2048 Jul 27 19:08:19.870612 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: lock engine: pthread robust mutexes Jul 27 19:08:19.870889 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: thunder lock: enabled Jul 27 19:08:19.871186 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 19:08:19.871381 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 19:08:19.916899 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: Python main interpreter initialized at 0x55be1f7239c0 Jul 27 19:08:19.916899 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: python threads support enabled Jul 27 19:08:19.916899 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: your server socket listen backlog is limited to 100 connections Jul 27 19:08:19.916899 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: your mercy for graceful operations on workers is 90 seconds Jul 27 19:08:19.917296 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 19:08:19.917374 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: *** Operational MODE: preforking *** Jul 27 19:08:19.917596 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: *** uWSGI is running in multiple interpreter mode *** Jul 27 19:08:19.917596 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: spawned uWSGI master process (pid: 87155) Jul 27 19:08:19.917829 dv-osbrick-849020-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 27 19:08:19.921692 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: spawned uWSGI worker 1 (pid: 87166, cores: 1) Jul 27 19:08:19.921692 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: spawned uWSGI worker 2 (pid: 87167, cores: 1) Jul 27 19:08:19.921692 dv-osbrick-849020-4-ceph devstack@keystone.service[87155]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 19:08:25.726994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:08:25.726994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: from cryptography.utils import int_from_bytes Jul 27 19:08:25.727767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:08:25.727767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: from cryptography.utils import int_from_bytes Jul 27 19:08:25.728753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:08:25.728753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: from cryptography.utils import int_from_bytes Jul 27 19:08:25.729198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:08:25.729198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: from cryptography.utils import int_from_bytes Jul 27 19:08:25.778800 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 19:08:25.779005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 19:08:25.779165 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] command line args: [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 19:08:25.779437 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 19:08:25.779619 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ================================================================================ {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 19:08:25.779881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] admin_token = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.780131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] config_dir = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.780207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 19:08:25.780321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.780401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 19:08:25.780504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] config_source = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.780580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] command line args: [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 19:08:25.780697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] debug = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.780814 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 19:08:25.780886 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ================================================================================ {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 19:08:25.781314 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] admin_token = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781449 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781513 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] config_dir = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] config_source = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.781951 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782022 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] debug = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] list_limit = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] log_config_append = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782648 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] log_dir = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782725 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782820 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] log_file = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.782890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783286 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] list_limit = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783513 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] log_config_append = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783591 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783707 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] log_dir = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.783919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] log_file = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784121 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784262 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784347 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784765 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.784848 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785000 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785083 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.785931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.786095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.786190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.786329 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.786565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.786690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.786800 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.786889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] publish_errors = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787051 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787307 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787625 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.787944 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] standard_threads = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788269 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] publish_errors = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788870 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.788995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789241 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] use_journal = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789501 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] use_json = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789501 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] use_stderr = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789805 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] use_syslog = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789877 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] standard_threads = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.789947 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790017 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.790222 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790294 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.790414 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790414 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] use_journal = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.790628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] use_json = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790698 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.790767 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] use_stderr = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] use_syslog = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.790969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.791070 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:08:25.791171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.791296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.791413 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.791539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.791643 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.791796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.791897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792104 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792509 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792587 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792755 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.792991 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793484 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793562 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793838 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.793986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794064 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794297 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794742 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794870 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.794995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.795127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.795268 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.795352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.795522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.795600 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.795772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.795856 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796003 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796093 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796343 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796463 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796570 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796838 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.796946 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797184 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797583 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.797942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798086 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798323 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798801 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.798879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799110 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799262 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799491 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799719 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799797 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.799920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800001 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800150 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800228 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800385 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800464 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800632 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800781 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.800926 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801083 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801160 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801537 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801613 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801793 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.801864 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802299 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802537 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802619 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802761 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.802970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803145 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803230 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803302 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803362 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803478 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.803903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804159 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804230 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804500 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804733 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804824 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.804971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805057 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805199 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805436 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805810 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.805937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806028 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806184 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806271 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806669 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806746 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.806908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807021 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807136 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807214 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807459 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807851 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.807934 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808171 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808324 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808409 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808637 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.808925 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809098 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809556 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809821 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.809978 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.810641 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.810872 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.810967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811126 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811369 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811449 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811770 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.811969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812069 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812314 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812487 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812567 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812733 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.812965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813285 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813433 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813765 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.813927 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814018 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814160 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814238 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.814896 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815058 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] auth.external = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.815856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816102 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] auth.password = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816477 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] auth.token = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816551 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816805 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.816951 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817031 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] auth.external = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817435 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817521 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817795 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.817961 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] auth.password = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] auth.token = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818271 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818425 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] credential.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818503 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818662 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818742 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.818990 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819461 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819704 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.819931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] credential.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820340 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820585 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.820916 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821156 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821546 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.821925 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822416 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822577 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822655 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.822914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823075 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823156 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823306 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823642 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823790 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.823893 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824291 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824386 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824721 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824802 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.824883 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.825015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.825102 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.825260 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.825339 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.825502 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.825581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.826403 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.826568 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.826648 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.826834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.826915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827345 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827424 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827838 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.827918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828172 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828572 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828803 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.828884 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829128 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829357 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829798 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.829880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830369 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830602 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830765 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.830996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831077 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831231 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831314 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831461 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831541 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.831938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832424 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832506 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832656 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832889 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.832976 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833129 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833478 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833597 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833868 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.833948 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834422 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834563 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.834878 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835271 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835349 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.835981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836060 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836221 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836300 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836910 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.836988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837152 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837244 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837384 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837619 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837761 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.837970 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838111 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838203 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838350 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838431 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838578 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838666 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838825 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.838904 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839072 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839151 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839306 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.839858 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840002 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840088 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840233 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840312 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840466 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840546 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840788 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.840928 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.841015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.841172 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.841252 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.841442 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.841532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.841703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.841919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842000 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842168 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842281 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842405 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842511 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.842964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.843131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.843230 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.843337 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.843418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.843576 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.843814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.843909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844216 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844397 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844555 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844726 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844842 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.844965 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845344 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.845994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846260 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846376 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846611 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846742 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846849 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.846981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847096 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.847960 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.848905 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849245 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849605 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] role.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849700 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849874 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] role.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.849959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850105 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850428 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850593 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850840 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.850920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851079 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.851899 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] role.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] role.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852559 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852729 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852809 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.852976 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.853056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.853222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.853302 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.853469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.853720 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.853808 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.853921 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854002 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854671 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854750 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.854919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855650 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.855891 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856318 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856648 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856821 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.856968 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.857107 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.857197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.857357 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.857594 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.857687 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.857861 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.857990 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858095 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858171 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858311 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858547 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.858876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859030 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859613 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.859847 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860248 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860328 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860561 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860717 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860797 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.860949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861182 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861261 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861427 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861506 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861805 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861914 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.861993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862156 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862413 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862657 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862737 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.connection = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.862993 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863244 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863468 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863623 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863702 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.863943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864205 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864314 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864631 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.864863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865094 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.connection = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865773 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.865855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866255 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866723 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.866959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.867047 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.867121 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 19:08:25.867195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.867425 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.867664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.867911 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.868147 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.868396 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.868634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.868883 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.869118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.869360 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.869888 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:08:25.870063 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 19:08:25.897338 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.897568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.897820 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.898951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.899186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.899415 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.906456 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.909525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.937222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.937494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.938432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.938669 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.991308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:25.991584 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.043210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.043512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.043660 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.043802 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.110831 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.111095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.111095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.111379 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.111514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.111647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.111794 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.111942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.112073 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.112209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.112209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.112474 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.137035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.137301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.137471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.137777 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.137945 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.138198 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.138350 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.138485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.138618 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.138792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.139132 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.139380 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.139721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.139942 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.150392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.152896 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.163725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.163951 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.164171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.164392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.164621 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.164784 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.164919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.165052 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.165184 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.165326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.165326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.165593 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.165742 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.165936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 19:08:26.182411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.182686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.182826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 19:08:26.182963 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 19:08:26.183098 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.183098 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 19:08:26.183353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.183353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 19:08:26.183609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.183740 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.183866 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.183997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.184134 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.184265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.184394 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.184521 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.194358 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.194532 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.194664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.194796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.194939 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.195071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.195198 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.195332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.204179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.204398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.207151 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.207281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.207428 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.207556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.207695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.207823 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.207947 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.208081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.208235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.208362 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.208488 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.208619 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.208746 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.208883 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209269 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209723 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.209982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.233398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.233742 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.234979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.235234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.235367 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.235521 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.239953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.240241 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.240374 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.240526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.240653 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.240784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.247633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.248281 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.248477 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.248650 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.252405 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.252563 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.252692 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.252818 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.252946 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.253071 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.253228 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.253368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.253636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.253801 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.253931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.254059 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.254199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.254328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.254455 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.254583 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.270118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.270392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.270522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.270770 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.274249 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.274689 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.277355 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.277658 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.277872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.278171 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.282767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.283258 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.285932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.286429 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.289046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.289338 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.289576 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.289739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.289908 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.290037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.290193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.290322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.290481 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.290622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.290867 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.291148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.306974 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.307255 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.307529 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.307788 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.307929 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.308083 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.308319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.308582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.314725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.315594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.316443 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.316724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.317352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.317636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.319419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.319700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.319985 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.320263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.320390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.320546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.320680 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.320868 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.321159 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.321438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.331956 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.332229 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.332504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.332778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.332931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.333074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.333201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.333328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.333469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.333596 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.333749 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.334032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.334308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.334582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.349530 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.350780 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.352544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.353809 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.356615 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.358659 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.358983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.360133 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.360497 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.360773 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.361056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.361664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.361958 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.362239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.474954 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.476474 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.477533 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.479090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.479354 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.479641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.479924 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.480196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.482632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.483027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.483316 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.483592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.488761 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.489052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.489330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.491607 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.491900 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.492181 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.496417 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.496806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.497085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.497369 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.497760 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.498470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.498470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.498727 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.498859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.499020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.499288 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.499424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 19:08:26.499559 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.499758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.499924 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.500108 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.500241 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.500375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.500558 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.500846 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.501122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.501393 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.501710 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.501981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.502254 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.502523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.502791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.503051 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 19:08:26.534070 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be1f7239c0 pid: 87167 (default app) Jul 27 19:08:26.536846 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be1f7239c0 pid: 87166 (default app) Jul 27 19:08:26.537769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e66c3-9182-4930-beae-7ed592783d4e None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:26.538063 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e66c3-9182-4930-beae-7ed592783d4e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:26.538340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e66c3-9182-4930-beae-7ed592783d4e None None] PATH_INFO: `/v3` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:26.542525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Wed Jul 27 19:08:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:34.873818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8643d-7107-4ea2-8798-b5ba88916bbd None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:34.874383 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8643d-7107-4ea2-8798-b5ba88916bbd None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:34.874383 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8643d-7107-4ea2-8798-b5ba88916bbd None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:34.878715 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:08:34.884453 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:34.884882 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:34.885014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:34.965024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: INFO dbcounter [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] Registered counter for database keystone Jul 27 19:08:34.988001 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG oslo_db.sqlalchemy.engines [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:08:34.994225 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writer thread running {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:08:35.172929 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG passlib.handlers.bcrypt [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87167) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 19:08:35.173355 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG passlib.handlers.bcrypt [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87167) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 19:08:35.229404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:35.231067 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:35.359726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 19:08:35.515075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8643d-7107-4ea2-8798-b5ba88916bbd None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:35.592964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: INFO dbcounter [None req-f9f8643d-7107-4ea2-8798-b5ba88916bbd None None] Registered counter for database keystone Jul 27 19:08:35.612693 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG oslo_db.sqlalchemy.engines [None req-f9f8643d-7107-4ea2-8798-b5ba88916bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:08:35.619013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writer thread running {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:08:35.744050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8643d-7107-4ea2-8798-b5ba88916bbd None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:35.749778 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53aaf-3785-400c-a573-800dd96894ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:35.750419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53aaf-3785-400c-a573-800dd96894ce admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:35.750702 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53aaf-3785-400c-a573-800dd96894ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:35.750977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53aaf-3785-400c-a573-800dd96894ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:35.759595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53aaf-3785-400c-a573-800dd96894ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:35.813571 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING keystone.common.rbac_enforcer.enforcer [None req-39d53aaf-3785-400c-a573-800dd96894ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 19:08:35.813940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53aaf-3785-400c-a573-800dd96894ce admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:35.824281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Wed Jul 27 19:08:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:08:35.830672 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:35.845298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee8c92-20d5-4410-bac7-e3bfe0da97b3 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:35.849880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669a0a4-6c14-4bb4-a291-17ed3db98c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:35.850989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a0a4-6c14-4bb4-a291-17ed3db98c51 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:35.851273 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a0a4-6c14-4bb4-a291-17ed3db98c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:35.851560 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a0a4-6c14-4bb4-a291-17ed3db98c51 admin admin] PATH_INFO: `/v3/projects/7bac04fe952a4d2c91db90416fe41f28` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:35.853046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669a0a4-6c14-4bb4-a291-17ed3db98c51 admin admin] RBAC: Authorizing `identity:get_project(project_id=7bac04fe952a4d2c91db90416fe41f28)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:35.905129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2669a0a4-6c14-4bb4-a291-17ed3db98c51 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 19:08:35.905814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669a0a4-6c14-4bb4-a291-17ed3db98c51 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:35.910325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Wed Jul 27 19:08:35 2022] GET /identity/v3/projects/7bac04fe952a4d2c91db90416fe41f28 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:38.190094 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea08f24-f6c5-46a8-9222-2b888baf4eee None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:38.190640 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea08f24-f6c5-46a8-9222-2b888baf4eee None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:38.190640 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea08f24-f6c5-46a8-9222-2b888baf4eee None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:38.194741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:08:38.201003 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5355-6d24-44df-8233-637411bf708b None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:38.201518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5355-6d24-44df-8233-637411bf708b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:38.201927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5355-6d24-44df-8233-637411bf708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:38.222864 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e68d5355-6d24-44df-8233-637411bf708b None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:38.224404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e68d5355-6d24-44df-8233-637411bf708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:38.232838 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 19:08:38.257492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea08f24-f6c5-46a8-9222-2b888baf4eee None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:38.270456 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea08f24-f6c5-46a8-9222-2b888baf4eee None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:38.274751 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23677286-2ed6-4591-a8b7-07b3d128f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:38.275366 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23677286-2ed6-4591-a8b7-07b3d128f361 admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:38.275653 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23677286-2ed6-4591-a8b7-07b3d128f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:38.275931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23677286-2ed6-4591-a8b7-07b3d128f361 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:38.284455 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23677286-2ed6-4591-a8b7-07b3d128f361 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:38.286282 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23677286-2ed6-4591-a8b7-07b3d128f361 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:38.295153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Wed Jul 27 19:08:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:08:38.300936 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5355-6d24-44df-8233-637411bf708b None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:38.311038 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5355-6d24-44df-8233-637411bf708b None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:38.315566 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f12a37-6409-4af3-ae1b-134b61fe4170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:38.316209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f12a37-6409-4af3-ae1b-134b61fe4170 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:38.316493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f12a37-6409-4af3-ae1b-134b61fe4170 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:38.316772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f12a37-6409-4af3-ae1b-134b61fe4170 admin admin] PATH_INFO: `/v3/users/9411e66c17864f3a88f0f7077545cca2` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:38.318177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f12a37-6409-4af3-ae1b-134b61fe4170 admin admin] RBAC: Authorizing `identity:get_user(user_id=9411e66c17864f3a88f0f7077545cca2)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:38.320003 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f12a37-6409-4af3-ae1b-134b61fe4170 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:38.321558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Wed Jul 27 19:08:38 2022] GET /identity/v3/users/9411e66c17864f3a88f0f7077545cca2 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:40.635609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef24c6-a388-485b-997e-56e61537da28 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:40.636284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef24c6-a388-485b-997e-56e61537da28 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:40.636284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef24c6-a388-485b-997e-56e61537da28 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:40.638183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:40.644943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540215a-b9f5-41a1-afc0-54231fac79e0 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:40.645447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540215a-b9f5-41a1-afc0-54231fac79e0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:40.645585 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540215a-b9f5-41a1-afc0-54231fac79e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:40.665787 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-1540215a-b9f5-41a1-afc0-54231fac79e0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:40.667012 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-1540215a-b9f5-41a1-afc0-54231fac79e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:40.710390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db9e5-4d25-46bb-9856-a8f96c04f6a7 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:40.710679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db9e5-4d25-46bb-9856-a8f96c04f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:40.710962 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db9e5-4d25-46bb-9856-a8f96c04f6a7 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:40.712307 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:40.718022 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:40.718309 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:40.718588 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:40.754781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:40.763231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG passlib.handlers.bcrypt [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87166) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 19:08:40.763715 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG passlib.handlers.bcrypt [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87166) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 19:08:40.780397 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540215a-b9f5-41a1-afc0-54231fac79e0 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:40.805796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:40.809160 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:40.811370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:40.897932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540215a-b9f5-41a1-afc0-54231fac79e0 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:40.921625 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:08:40.932901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:40.933556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:40.933867 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:40.934143 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:40.946756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:08:40.950284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:08:40.956046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:40.957153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:08:40.958168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:08:40.963100 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:41.045830 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:41.056328 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8a1e-2d83-4cfc-95e1-c040c9d40b77 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:41.058977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:41.065458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a83b5-f87a-4594-9953-83081a4d0a5c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:41.096648 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:41.097537 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:41.097860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:41.098140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:41.105232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:41.105892 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:41.106712 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:41.106991 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:41.107731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:41.108034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:41.109442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:41.121844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:41.128121 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:41.173231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:41.174734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:41.232493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46446e-4440-48f9-b69b-599ade73c11e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:41.268982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:41.269683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:41.269953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:41.270231 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] PATH_INFO: `/v3/users/9411e66c17864f3a88f0f7077545cca2` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:41.271504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=9411e66c17864f3a88f0f7077545cca2)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:41.273006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:41.274738 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 9/16] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:08:41 2022] GET /identity/v3/users/9411e66c17864f3a88f0f7077545cca2 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:41.279976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 8/17] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 19:08:41.284996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:41.286085 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:41.289719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:41.300677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:41.397887 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe0e0-c788-41c3-91da-23ac7a093bb2 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:41.398566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643603a-e3e1-406d-84bb-fb90c19e9ab2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:41.434115 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:41.435189 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:41.435473 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:41.435787 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:41.437047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:41.438003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:41.438540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:41.438886 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:41.439172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:41.439448 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:41.440169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 10/18] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:41.446331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:41.463240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:41.464753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:08:41.484674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:41.485679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:41.486491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:08:41.486491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:08:41.486491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:08:41.486491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:08:41.486491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 9/19] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:08:41.492753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:41.536489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:41.551892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:41.556997 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9f71d-32d4-4f8d-80df-ae0e1e04e3ab None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:41.594600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8ff24-1925-4749-888f-98f4548df8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:41.595277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ff24-1925-4749-888f-98f4548df8e6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:41.595610 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ff24-1925-4749-888f-98f4548df8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:41.595968 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ff24-1925-4749-888f-98f4548df8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:41.596630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8ff24-1925-4749-888f-98f4548df8e6 None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.domain.id=default, user.id=9411e66c17864f3a88f0f7077545cca2) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:41.596753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c5092-ca2b-4125-b38b-cd32086f05f4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:41.596933 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8ff24-1925-4749-888f-98f4548df8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:41.598421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8ff24-1925-4749-888f-98f4548df8e6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:41.605099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Wed Jul 27 19:08:41 2022] GET /identity/v3/role_assignments?user.id=9411e66c17864f3a88f0f7077545cca2&scope.domain.id=default&role.id=40fb60241dc645059f308de1b41e6e44 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:41.634140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965ed2d-8a8c-4353-ae86-8345611e49e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:41.634786 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ed2d-8a8c-4353-ae86-8345611e49e8 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:41.635078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ed2d-8a8c-4353-ae86-8345611e49e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:41.635360 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ed2d-8a8c-4353-ae86-8345611e49e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:41.636081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965ed2d-8a8c-4353-ae86-8345611e49e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:41.636675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965ed2d-8a8c-4353-ae86-8345611e49e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:41.638868 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965ed2d-8a8c-4353-ae86-8345611e49e8 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:41.659061 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:44.385381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46af8-25ae-4439-88d0-c288620f293a None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:44.386475 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46af8-25ae-4439-88d0-c288620f293a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:44.386956 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e46af8-25ae-4439-88d0-c288620f293a None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:44.388797 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:44.394542 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71da7-e64f-497c-8560-561f32364911 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:44.395459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71da7-e64f-497c-8560-561f32364911 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:44.395925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71da7-e64f-497c-8560-561f32364911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:44.422787 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-efa71da7-e64f-497c-8560-561f32364911 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:44.424382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-efa71da7-e64f-497c-8560-561f32364911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:44.512263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:44.518415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5672c3-aa91-4fcf-a4fe-b3a6358c3929 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:44.519008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5672c3-aa91-4fcf-a4fe-b3a6358c3929 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:44.519475 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5672c3-aa91-4fcf-a4fe-b3a6358c3929 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:44.521039 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:44.539569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9aeec-984c-4599-b18c-8d6a7b02e620 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:44.539862 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9aeec-984c-4599-b18c-8d6a7b02e620 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:44.540137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9aeec-984c-4599-b18c-8d6a7b02e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:44.554286 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5672c3-aa91-4fcf-a4fe-b3a6358c3929 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:44.564012 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-fbc9aeec-984c-4599-b18c-8d6a7b02e620 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:44.565208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-fbc9aeec-984c-4599-b18c-8d6a7b02e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:44.650016 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:44.696519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 12/25] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:44.697843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36943a19-c608-4043-a2ae-7c60c5d0e9fb None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:44.698131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36943a19-c608-4043-a2ae-7c60c5d0e9fb None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:44.698406 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36943a19-c608-4043-a2ae-7c60c5d0e9fb None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:44.700805 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 13/26] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:44.707420 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8169-93d3-42a2-b84a-113e4faf95ed None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:44.707703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8169-93d3-42a2-b84a-113e4faf95ed None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:44.707980 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8169-93d3-42a2-b84a-113e4faf95ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:44.753792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-f49d8169-93d3-42a2-b84a-113e4faf95ed None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:44.755247 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-f49d8169-93d3-42a2-b84a-113e4faf95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:44.816908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5672c3-aa91-4fcf-a4fe-b3a6358c3929 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:44.858541 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 14/27] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:44.860903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8169-93d3-42a2-b84a-113e4faf95ed None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:44.887912 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:44.888950 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:44.891085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:44.891568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:44.910489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:44.914058 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:44.920406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:08:44.950654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:44.951534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:44.952334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:08:44.952334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:08:44.952334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:08:44.952334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:08:44.957836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 14/28] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:08:44.958871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:45.031051 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8169-93d3-42a2-b84a-113e4faf95ed None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:45.041336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:45.077441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:45.078440 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.078907 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.079351 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.092201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:08:45.099043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:45.099925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:45.100746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:08:45.103071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 15/29] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:08:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:08:45.104106 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:45.121221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36297460-e41b-4e1e-86a2-a8da327e1311 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:45.158903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:45.159866 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.160339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.160859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.161815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:45.163589 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:45.241918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a3b5-4ca3-428c-b4dd-af8fb0574436 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:45.284369 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1cf12-63ab-482d-817b-03c27ad2621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:45.285115 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cf12-63ab-482d-817b-03c27ad2621f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.285409 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cf12-63ab-482d-817b-03c27ad2621f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.285713 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cf12-63ab-482d-817b-03c27ad2621f None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.286435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1cf12-63ab-482d-817b-03c27ad2621f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:45.286752 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1cf12-63ab-482d-817b-03c27ad2621f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:45.288215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1cf12-63ab-482d-817b-03c27ad2621f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:45.301569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 16/30] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:45.303055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec00cf0-2d90-4c16-9d9a-73a3563acd61 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.303391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec00cf0-2d90-4c16-9d9a-73a3563acd61 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.303730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec00cf0-2d90-4c16-9d9a-73a3563acd61 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.309848 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 17/31] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:45.310783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec00cf0-2d90-4c16-9d9a-73a3563acd61 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:45.334934 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 15/32] 10.222.0.71 () {60 vars in 1131 bytes} [Wed Jul 27 19:08:44 2022] POST /identity/v3/roles => generated 225 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:08:45.336503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:45.352249 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:45.412326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:45.519111 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec00cf0-2d90-4c16-9d9a-73a3563acd61 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:45.532129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16849-79c0-467e-8763-346e864f2eea None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:45.574453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06f6e4-d20c-46c0-b4c3-a852929ca22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:45.576511 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06f6e4-d20c-46c0-b4c3-a852929ca22f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.576803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06f6e4-d20c-46c0-b4c3-a852929ca22f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.577081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06f6e4-d20c-46c0-b4c3-a852929ca22f None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.578006 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06f6e4-d20c-46c0-b4c3-a852929ca22f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:45.578662 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06f6e4-d20c-46c0-b4c3-a852929ca22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:45.580348 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06f6e4-d20c-46c0-b4c3-a852929ca22f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:45.586862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:45.587599 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.587890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.588170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.588861 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:45.591810 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:45.595473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 18/33] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:45.596750 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ed9a-cba9-4a52-a2d1-f78ba910c033 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.597043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ed9a-cba9-4a52-a2d1-f78ba910c033 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.597321 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ed9a-cba9-4a52-a2d1-f78ba910c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.620982 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-9ba5ed9a-cba9-4a52-a2d1-f78ba910c033 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:45.623057 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9ba5ed9a-cba9-4a52-a2d1-f78ba910c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:45.636514 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 16/34] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:08:45 2022] POST /identity/v3/projects => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:08:45.638332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:45.791386 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 19/35] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:45.793627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209936f-5f93-4396-b865-da250cd64e8a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:45.805901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:45.836392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ed9a-cba9-4a52-a2d1-f78ba910c033 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:45.837371 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:45.838322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:45.839042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:45.839495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] PATH_INFO: `/v3/users/9411e66c17864f3a88f0f7077545cca2` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:45.841204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] RBAC: Authorizing `identity:get_user(user_id=9411e66c17864f3a88f0f7077545cca2)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:45.844137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:45.850717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 17/36] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:08:45 2022] GET /identity/v3/users/9411e66c17864f3a88f0f7077545cca2 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:45.854332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:45.887300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:45.999278 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9b085-47fe-454d-b6f0-7c5f7086d74c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:46.053199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ed9a-cba9-4a52-a2d1-f78ba910c033 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:46.058480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2bcac-2f48-42af-a0bb-3d35bfa9be97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:46.059881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2bcac-2f48-42af-a0bb-3d35bfa9be97 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.060143 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2bcac-2f48-42af-a0bb-3d35bfa9be97 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.060422 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2bcac-2f48-42af-a0bb-3d35bfa9be97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.061665 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2bcac-2f48-42af-a0bb-3d35bfa9be97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:46.063145 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2bcac-2f48-42af-a0bb-3d35bfa9be97 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:46.064792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 18/37] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:46.068140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389163e-0660-4cdf-8c4a-25c966ca3c63 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.068140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389163e-0660-4cdf-8c4a-25c966ca3c63 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.068140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389163e-0660-4cdf-8c4a-25c966ca3c63 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.068140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 19/38] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:46.073109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389163e-0660-4cdf-8c4a-25c966ca3c63 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:46.099554 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed3a0a-45e9-4bf5-83de-bba6572f69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:46.100177 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3a0a-45e9-4bf5-83de-bba6572f69c7 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.100792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3a0a-45e9-4bf5-83de-bba6572f69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.100792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3a0a-45e9-4bf5-83de-bba6572f69c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.101424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed3a0a-45e9-4bf5-83de-bba6572f69c7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:46.102843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed3a0a-45e9-4bf5-83de-bba6572f69c7 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:46.129981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:46.192181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389163e-0660-4cdf-8c4a-25c966ca3c63 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:46.229047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142586-ca0b-4b89-9358-51426463e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:46.229759 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142586-ca0b-4b89-9358-51426463e61e None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.230047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142586-ca0b-4b89-9358-51426463e61e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.230336 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142586-ca0b-4b89-9358-51426463e61e None admin] PATH_INFO: `/v3/domains/default/users/9411e66c17864f3a88f0f7077545cca2/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.232403 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c142586-ca0b-4b89-9358-51426463e61e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9411e66c17864f3a88f0f7077545cca2, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:46.233888 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c142586-ca0b-4b89-9358-51426463e61e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:46.235561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 20/39] 10.222.0.71 () {60 vars in 1131 bytes} [Wed Jul 27 19:08:45 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:08:46.237032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ccb1-5d3f-462d-9351-ed0b627402af None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.237325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ccb1-5d3f-462d-9351-ed0b627402af None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.237605 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ccb1-5d3f-462d-9351-ed0b627402af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.253743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 20/40] 10.222.0.71 () {58 vars in 1361 bytes} [Wed Jul 27 19:08:46 2022] PUT /identity/v3/domains/default/users/9411e66c17864f3a88f0f7077545cca2/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:08:46.255846 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ac14a-d835-4b63-a067-acd4ede8097d None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.256406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ac14a-d835-4b63-a067-acd4ede8097d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.256903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ac14a-d835-4b63-a067-acd4ede8097d None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.258639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 21/41] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:46.267121 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-b8f4ccb1-5d3f-462d-9351-ed0b627402af None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:46.269288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-b8f4ccb1-5d3f-462d-9351-ed0b627402af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:46.275430 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95cf00-2c6e-4484-b7eb-1280322cedc5 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.275768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95cf00-2c6e-4484-b7eb-1280322cedc5 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.275998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95cf00-2c6e-4484-b7eb-1280322cedc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.314219 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-6b95cf00-2c6e-4484-b7eb-1280322cedc5 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:46.317493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-6b95cf00-2c6e-4484-b7eb-1280322cedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:46.368993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 21/42] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:46.395276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4ccb1-5d3f-462d-9351-ed0b627402af None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:46.408206 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:46.436972 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 22/43] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:46.463569 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95cf00-2c6e-4484-b7eb-1280322cedc5 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:46.506263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:46.547709 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4ccb1-5d3f-462d-9351-ed0b627402af None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:46.586307 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95cf00-2c6e-4484-b7eb-1280322cedc5 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:46.586645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:46.587436 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.587933 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.588224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.589825 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:46.591994 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:46.610288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 22/44] 10.222.0.71 () {60 vars in 1131 bytes} [Wed Jul 27 19:08:46 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:08:46.626773 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbd5f7-abb9-4b0b-8806-974f6b4670f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:46.627450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd5f7-abb9-4b0b-8806-974f6b4670f9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.627755 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd5f7-abb9-4b0b-8806-974f6b4670f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.628024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbd5f7-abb9-4b0b-8806-974f6b4670f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.629324 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbd5f7-abb9-4b0b-8806-974f6b4670f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:46.630897 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbd5f7-abb9-4b0b-8806-974f6b4670f9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:46.632857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 23/45] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:46.638653 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:46.718606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:46.767758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1ee1-0229-4ecb-af73-39fe5ced595d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:46.805560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfd24c-8812-419d-b387-a1cc7be5b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:46.806230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfd24c-8812-419d-b387-a1cc7be5b509 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:46.806511 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfd24c-8812-419d-b387-a1cc7be5b509 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:46.806782 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfd24c-8812-419d-b387-a1cc7be5b509 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:46.807773 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfd24c-8812-419d-b387-a1cc7be5b509 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:46.810122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfd24c-8812-419d-b387-a1cc7be5b509 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:46.842048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 23/46] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:08:46 2022] POST /identity/v3/projects => generated 312 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:08:48.595509 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d30f-4e39-4832-a3ae-ec6548e48509 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:48.596084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d30f-4e39-4832-a3ae-ec6548e48509 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:48.596084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d30f-4e39-4832-a3ae-ec6548e48509 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:48.597421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 24/47] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:48.602932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e6bff-d429-42e6-a34c-a2af6b3e0557 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:48.603352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e6bff-d429-42e6-a34c-a2af6b3e0557 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:48.603504 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e6bff-d429-42e6-a34c-a2af6b3e0557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:48.623138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-f80e6bff-d429-42e6-a34c-a2af6b3e0557 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:48.624334 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-f80e6bff-d429-42e6-a34c-a2af6b3e0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:48.694803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 24/48] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:48.720437 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d30f-4e39-4832-a3ae-ec6548e48509 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:48.827611 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d30f-4e39-4832-a3ae-ec6548e48509 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:48.829326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:48.865674 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:48.866243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:48.866529 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:48.866806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:48.878409 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:08:48.883364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:48.884401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:08:48.885224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 25/49] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:08:48.891274 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e6bff-d429-42e6-a34c-a2af6b3e0557 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:48.944319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:48.999400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e6bff-d429-42e6-a34c-a2af6b3e0557 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:49.034458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c5606-bcb6-49a0-b5cf-3eecbbb285d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:49.035169 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c5606-bcb6-49a0-b5cf-3eecbbb285d1 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.035457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c5606-bcb6-49a0-b5cf-3eecbbb285d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.035735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c5606-bcb6-49a0-b5cf-3eecbbb285d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.036457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c5606-bcb6-49a0-b5cf-3eecbbb285d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:49.036762 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c5606-bcb6-49a0-b5cf-3eecbbb285d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:49.038180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c5606-bcb6-49a0-b5cf-3eecbbb285d1 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:49.047528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 25/50] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:08:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:49.053012 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:49.088406 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff761c4-23fe-4433-a457-1db1dda80774 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.088792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff761c4-23fe-4433-a457-1db1dda80774 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.089133 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff761c4-23fe-4433-a457-1db1dda80774 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.091168 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 26/51] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:08:49.096291 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87e29-7258-4577-a13c-13a44bb27781 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.096581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87e29-7258-4577-a13c-13a44bb27781 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.096863 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87e29-7258-4577-a13c-13a44bb27781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.115266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-d7c87e29-7258-4577-a13c-13a44bb27781 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:49.116518 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-d7c87e29-7258-4577-a13c-13a44bb27781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:49.155735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8cde2-1388-4419-a250-7ab32edac0f4 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:49.185351 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 27/52] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:08:49.189938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:49.190582 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.190862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.191135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] PATH_INFO: `/v3/users/9411e66c17864f3a88f0f7077545cca2` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.192295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] RBAC: Authorizing `identity:get_user(user_id=9411e66c17864f3a88f0f7077545cca2)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:49.193780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:49.195372 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:08:49 2022] GET /identity/v3/users/9411e66c17864f3a88f0f7077545cca2 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:49.201250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87e29-7258-4577-a13c-13a44bb27781 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:49.210740 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:49.241092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:49.246190 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:49.306664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87e29-7258-4577-a13c-13a44bb27781 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:49.312941 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca5df1-3f2b-4889-9d12-5376ce6542cf None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:49.344731 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:49.345381 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.345780 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.346066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.347246 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:49.348703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:49.350374 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 28/54] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:49.350799 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:49.351451 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.351728 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.352002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.353202 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:49.354709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:49.356329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:49.356852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:49.362139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:49.467995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:49.470971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b3ac-e09f-404a-bc9d-30b3e664b27c None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:49.472886 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6a9a2-af24-452d-9b6e-4c72ca9a54e7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:49.484805 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:49.514529 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb43d9-c05b-4f2f-b7e0-5ad897a16f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:49.515382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb43d9-c05b-4f2f-b7e0-5ad897a16f99 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.515793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb43d9-c05b-4f2f-b7e0-5ad897a16f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.516706 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb43d9-c05b-4f2f-b7e0-5ad897a16f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.517632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb43d9-c05b-4f2f-b7e0-5ad897a16f99 None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.domain.id=default, user.id=9411e66c17864f3a88f0f7077545cca2) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:49.518139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb43d9-c05b-4f2f-b7e0-5ad897a16f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:49.519871 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb43d9-c05b-4f2f-b7e0-5ad897a16f99 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:49.524106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72663938-2edc-4c61-a6a0-82535f1581e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:49.525403 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663938-2edc-4c61-a6a0-82535f1581e6 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:49.525889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663938-2edc-4c61-a6a0-82535f1581e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:49.526353 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663938-2edc-4c61-a6a0-82535f1581e6 None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:49.527517 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72663938-2edc-4c61-a6a0-82535f1581e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:49.531000 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72663938-2edc-4c61-a6a0-82535f1581e6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:49.535271 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 29/56] 10.222.0.71 () {56 vars in 1322 bytes} [Wed Jul 27 19:08:49 2022] GET /identity/v3/role_assignments?user.id=9411e66c17864f3a88f0f7077545cca2&scope.domain.id=default&role.id=40fb60241dc645059f308de1b41e6e44 => generated 530 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:49.577935 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 28/57] 10.222.0.71 () {60 vars in 1140 bytes} [Wed Jul 27 19:08:49 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:08:51.922388 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcbfe-b531-42d5-a15e-03d645f05d1d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:51.923209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcbfe-b531-42d5-a15e-03d645f05d1d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:51.923209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcbfe-b531-42d5-a15e-03d645f05d1d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:51.924280 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 30/58] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:51.929340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cabcb-6400-4aa5-b3e7-b9e50c040143 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:51.929768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cabcb-6400-4aa5-b3e7-b9e50c040143 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:51.929924 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cabcb-6400-4aa5-b3e7-b9e50c040143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:51.947690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-cf7cabcb-6400-4aa5-b3e7-b9e50c040143 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:51.948884 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-cf7cabcb-6400-4aa5-b3e7-b9e50c040143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:52.015230 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 29/59] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:52.040293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfcbfe-b531-42d5-a15e-03d645f05d1d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:52.141080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfcbfe-b531-42d5-a15e-03d645f05d1d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:52.174361 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab6571-b2fb-413f-86a2-1cb8a5bf134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:52.174996 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6571-b2fb-413f-86a2-1cb8a5bf134f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:52.175275 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6571-b2fb-413f-86a2-1cb8a5bf134f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:52.175547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6571-b2fb-413f-86a2-1cb8a5bf134f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:52.176696 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab6571-b2fb-413f-86a2-1cb8a5bf134f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:52.178175 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab6571-b2fb-413f-86a2-1cb8a5bf134f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:52.179757 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 31/60] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:08:52.185490 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cabcb-6400-4aa5-b3e7-b9e50c040143 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:52.264738 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:52.285149 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cabcb-6400-4aa5-b3e7-b9e50c040143 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:52.317655 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9d5a-01da-4903-bc6f-f1525a3e6ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:52.318298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9d5a-01da-4903-bc6f-f1525a3e6ab7 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:52.318586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9d5a-01da-4903-bc6f-f1525a3e6ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:52.318866 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9d5a-01da-4903-bc6f-f1525a3e6ab7 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:52.319548 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9d5a-01da-4903-bc6f-f1525a3e6ab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:52.320997 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9d5a-01da-4903-bc6f-f1525a3e6ab7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:52.349138 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 30/61] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:08:52 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:08:55.774992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82b0f-525f-416e-b597-8eb32154a612 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:55.775969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82b0f-525f-416e-b597-8eb32154a612 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:55.776441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82b0f-525f-416e-b597-8eb32154a612 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:55.778110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 32/62] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:55.783874 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7a065-d523-489a-be65-4245b5dda840 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:55.784788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7a065-d523-489a-be65-4245b5dda840 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:55.785282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7a065-d523-489a-be65-4245b5dda840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:55.818794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-f3d7a065-d523-489a-be65-4245b5dda840 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:55.820472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f3d7a065-d523-489a-be65-4245b5dda840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:55.938255 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af35cd-3503-4b4f-8708-d52c2596f755 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:55.938627 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af35cd-3503-4b4f-8708-d52c2596f755 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:55.939048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af35cd-3503-4b4f-8708-d52c2596f755 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:55.940267 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 33/63] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:55.951465 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836362-92c6-4dec-94a8-57335267b085 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:55.951971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836362-92c6-4dec-94a8-57335267b085 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:55.952407 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836362-92c6-4dec-94a8-57335267b085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:55.988910 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 31/64] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:56.001718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-cf836362-92c6-4dec-94a8-57335267b085 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:56.002953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-cf836362-92c6-4dec-94a8-57335267b085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:56.050028 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7a065-d523-489a-be65-4245b5dda840 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:56.081225 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:56.147896 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 34/65] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:56.186056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:56.207853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf836362-92c6-4dec-94a8-57335267b085 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:56.252191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7a065-d523-489a-be65-4245b5dda840 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:56.317994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373e485-9555-495d-b810-786e8a012265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:56.319135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e485-9555-495d-b810-786e8a012265 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.319776 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e485-9555-495d-b810-786e8a012265 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.320278 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e485-9555-495d-b810-786e8a012265 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.338311 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373e485-9555-495d-b810-786e8a012265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-4373e485-9555-495d-b810-786e8a012265 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:08:56.344009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:56.344959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:08:56.345955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:08:56.348702 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 32/66] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:08:56.350959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0af78-085e-4606-94b5-3a7814970dbb None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.351578 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0af78-085e-4606-94b5-3a7814970dbb None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.351863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0af78-085e-4606-94b5-3a7814970dbb None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.357934 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 33/67] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:56.359171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0af78-085e-4606-94b5-3a7814970dbb None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:56.370301 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf836362-92c6-4dec-94a8-57335267b085 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:56.427695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c63c3-83f4-43f1-becf-97ff75685966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:56.428363 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c63c3-83f4-43f1-becf-97ff75685966 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.428641 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c63c3-83f4-43f1-becf-97ff75685966 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.428910 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c63c3-83f4-43f1-becf-97ff75685966 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.449906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c63c3-83f4-43f1-becf-97ff75685966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-b23c63c3-83f4-43f1-becf-97ff75685966 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:08:56.458095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:56.459110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:08:56.460028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:08:56.462122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 35/68] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:08:56.464650 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27ddf-dde2-476d-a266-b8bb5abf03f5 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.466240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27ddf-dde2-476d-a266-b8bb5abf03f5 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.466681 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27ddf-dde2-476d-a266-b8bb5abf03f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.492110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-30a27ddf-dde2-476d-a266-b8bb5abf03f5 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:56.494553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-30a27ddf-dde2-476d-a266-b8bb5abf03f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:56.502417 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0af78-085e-4606-94b5-3a7814970dbb None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:56.529771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:56.531764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:56.541080 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:56.541739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.542026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.542306 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.543693 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:56.544135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:56.545758 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:56.554413 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:56.558652 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:56.572553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 36/70] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:56.573926 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816930fb-d332-4959-b934-3a1bd64a877d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.574252 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816930fb-d332-4959-b934-3a1bd64a877d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.574535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816930fb-d332-4959-b934-3a1bd64a877d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.575963 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 37/71] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:56.577008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8873cc-c3db-4186-ac78-30740295b64e None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.577257 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8873cc-c3db-4186-ac78-30740295b64e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.577538 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8873cc-c3db-4186-ac78-30740295b64e None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.583634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 38/72] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:08:56.583634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8873cc-c3db-4186-ac78-30740295b64e None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:56.673904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efce34-b35c-4cc6-8216-959c14405e2a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:56.693059 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8873cc-c3db-4186-ac78-30740295b64e None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:56.708273 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ece5a-6d2d-4c90-85c5-0c09060aaf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:56.709127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ece5a-6d2d-4c90-85c5-0c09060aaf04 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.709409 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ece5a-6d2d-4c90-85c5-0c09060aaf04 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.711173 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ece5a-6d2d-4c90-85c5-0c09060aaf04 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.711911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ece5a-6d2d-4c90-85c5-0c09060aaf04 None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:56.712222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ece5a-6d2d-4c90-85c5-0c09060aaf04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:56.713604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ece5a-6d2d-4c90-85c5-0c09060aaf04 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:56.723290 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 35/73] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:56.723290 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2f0b1-39fe-4783-81b6-fdec5c3a052f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.723290 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2f0b1-39fe-4783-81b6-fdec5c3a052f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.723290 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2f0b1-39fe-4783-81b6-fdec5c3a052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.733704 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1591c-e792-4468-9d52-746db53ea6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:56.734379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1591c-e792-4468-9d52-746db53ea6f8 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.734667 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1591c-e792-4468-9d52-746db53ea6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.734948 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1591c-e792-4468-9d52-746db53ea6f8 None admin] PATH_INFO: `/v3/users/9411e66c17864f3a88f0f7077545cca2` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.736411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1591c-e792-4468-9d52-746db53ea6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=9411e66c17864f3a88f0f7077545cca2)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:56.737906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1591c-e792-4468-9d52-746db53ea6f8 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:56.739540 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 39/74] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/users/9411e66c17864f3a88f0f7077545cca2 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:56.740688 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7dec5-76cc-4d13-ad98-d4cbd79f2875 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.740975 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7dec5-76cc-4d13-ad98-d4cbd79f2875 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.741256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7dec5-76cc-4d13-ad98-d4cbd79f2875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.744677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-98a2f0b1-39fe-4783-81b6-fdec5c3a052f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:56.746006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-98a2f0b1-39fe-4783-81b6-fdec5c3a052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:56.759357 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-d5f7dec5-76cc-4d13-ad98-d4cbd79f2875 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:56.761268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-d5f7dec5-76cc-4d13-ad98-d4cbd79f2875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:56.786876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:56.799699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:56.821222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 36/75] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:56.822098 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2f0b1-39fe-4783-81b6-fdec5c3a052f None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:56.835496 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 40/76] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:08:56.845882 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7dec5-76cc-4d13-ad98-d4cbd79f2875 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:56.944472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2f0b1-39fe-4783-81b6-fdec5c3a052f None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:56.950492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7dec5-76cc-4d13-ad98-d4cbd79f2875 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:56.981082 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:56.981726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.982011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.982290 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.985307 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:56.985985 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:56.986326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:56.986601 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:56.992600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:08:56.998201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:56.999263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:08:57.000146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 37/77] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:08:57.002476 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.006182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.007644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.009449 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 41/78] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:57.010112 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.029920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.051419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.110918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969307b6-77ae-40c5-85a1-ffe40e33284b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.111822 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb0fc0-18b9-430b-9d7b-441189a9e070 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.147855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.148567 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.148880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.149062 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.151025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.152050 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.152697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.153400 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.159752 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:08:57.164701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:08:57.165526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:08:57.166341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 42/79] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:08:57.167271 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.229535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.231412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.265777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.275405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.288390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daff2b2-6ae6-4071-812c-972a245aee55 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.323608 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.324832 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.325116 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.325395 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.326706 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.328139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.334355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 43/80] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:57.334355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.338042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 38/81] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:08:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:08:57.338889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.441814 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01439-ad98-4da5-87a3-3c0599197f4b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.442052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c8b2e-1c1b-4bfa-b9ad-ba4ce198b17e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.485481 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.486131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.486414 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.486550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.486696 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.487161 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.487392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] RBAC: Adding query filter params (name=member) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:57.487478 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.487694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.487781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.489070 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.500026 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 44/82] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:57.500026 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.501075 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.512123 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.562988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.564368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.603867 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b97ad-6877-45f9-8e5c-056aee870a5c None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.638670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.639291 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.639572 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.639847 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.640558 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:57.640860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.642290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.650490 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 45/83] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:57.651264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.665713 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 39/84] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:08:57.666657 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.713946 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.738373 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:57.770983 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e77783-95b8-4f43-b890-d0a3fe453d6f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.778255 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bbbfb-7854-45f9-9910-95ae7aef3b5d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.808304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.809807 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.809906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.810115 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.810793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.812234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.813388 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:57.814040 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:57.814326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:57.814606 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:57.815767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:57.817210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:57.818916 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 40/85] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:57.819674 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.841061 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 46/86] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:08:57 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:08:57.841938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:57.975183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268efad-4536-475b-9568-b8115935e8d7 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.981686 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae288a07-3f77-4a16-9815-499d969c887b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:57.992421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:58.009182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:58.022856 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:58.023450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:58.023568 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:58.023790 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:58.024067 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:58.024160 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:58.024376 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:58.024706 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:58.025280 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:58.025939 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:58.026809 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:58.027474 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:58.028847 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 47/87] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:58.029413 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:58.038489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 41/88] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:08:57 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:58.038489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:58.166613 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778c490-274f-4380-a1b0-6ead3b1b37e7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:58.168420 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b0df-bc74-437c-8cac-db37306aeb6d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:58.210316 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:58.210513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:58.210988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:58.211135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:58.211363 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:58.211458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:58.211528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:58.211592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:58.212318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=9411e66c17864f3a88f0f7077545cca2) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:58.212627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:58.212717 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:58.214127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:58.214227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:58.216333 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 48/89] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:08:58 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:58.217044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:58.221401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 42/90] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:08:58 2022] GET /identity/v3/role_assignments?user.id=9411e66c17864f3a88f0f7077545cca2&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=40fb60241dc645059f308de1b41e6e44 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:58.222317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:58.283313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:58.310399 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:58.352592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c7ea7-d9af-4daa-b0a8-138a252c4a2d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:58.370185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae9c63-0d75-4172-aa0d-8761c8dd0071 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:58.408439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:58.409086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:58.409367 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:58.409638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:58.419133 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:58.419695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:58.419973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:58.420244 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:58.503740 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:58.505553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:58.547788 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:58.549145 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:58.561537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:58.632236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 43/91] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:08:58.633503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:58.697526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:58.756356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 49/92] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:08:58.757233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:58.790247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa070c80-e962-4238-b6bd-40b426dbe18a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:58.860024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:58.862956 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:58.863704 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:58.864621 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:58.866604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=b49cb583333c4029958b28bd0ef12234) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:58.867442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:58.870557 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:58.883011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 44/93] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:08:58 2022] GET /identity/v3/role_assignments?user.id=b49cb583333c4029958b28bd0ef12234&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:58.884720 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:58.891931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:59.019833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dd7fe-c06f-4d40-832b-f06086b020bd None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:59.082214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:59.082792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:59.083076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:59.083354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] PATH_INFO: `/v3/projects/8791970225dc4c87a289b6e5da8607e2` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:59.084684 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] RBAC: Authorizing `identity:get_project(project_id=8791970225dc4c87a289b6e5da8607e2)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:59.086252 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:59.088054 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 50/94] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:08:58 2022] GET /identity/v3/projects/8791970225dc4c87a289b6e5da8607e2 => generated 312 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:59.095177 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:59.098338 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3479b-fc8f-4ee9-b523-4dc06714d7ac None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:59.128456 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:59.170519 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:59.172218 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:59.172935 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:59.173749 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:59.175877 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:59.178528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:59.182713 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 45/95] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:08:58 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:59.193147 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:59.207554 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368907a-a51e-478a-8aeb-3b0d646d3547 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:59.245606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e606c5-41fe-4dc9-b49d-3f0ca67c0c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:59.246510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e606c5-41fe-4dc9-b49d-3f0ca67c0c28 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:59.246650 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e606c5-41fe-4dc9-b49d-3f0ca67c0c28 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:59.246990 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e606c5-41fe-4dc9-b49d-3f0ca67c0c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:59.247639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e606c5-41fe-4dc9-b49d-3f0ca67c0c28 None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=8791970225dc4c87a289b6e5da8607e2, user.id=b49cb583333c4029958b28bd0ef12234) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:59.247947 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e606c5-41fe-4dc9-b49d-3f0ca67c0c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:59.249575 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e606c5-41fe-4dc9-b49d-3f0ca67c0c28 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:59.255586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 51/96] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:08:59 2022] GET /identity/v3/role_assignments?user.id=b49cb583333c4029958b28bd0ef12234&scope.project.id=8791970225dc4c87a289b6e5da8607e2&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:08:59.337979 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:59.394016 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66cb5-6f24-4935-b8e8-c3e82085eefd None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:59.454974 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2152e-7233-4884-9832-308274cd1b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:59.456467 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2152e-7233-4884-9832-308274cd1b7e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:59.457214 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2152e-7233-4884-9832-308274cd1b7e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:59.458001 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2152e-7233-4884-9832-308274cd1b7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:59.459738 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2152e-7233-4884-9832-308274cd1b7e None admin] RBAC: Adding query filter params (role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=b49cb583333c4029958b28bd0ef12234) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:08:59.460530 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2152e-7233-4884-9832-308274cd1b7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:59.463481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2152e-7233-4884-9832-308274cd1b7e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:59.475486 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 46/97] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:08:59 2022] GET /identity/v3/role_assignments?user.id=b49cb583333c4029958b28bd0ef12234&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:00.855470 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fedd6-d618-4573-9c1a-f4be3482288c None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:00.856018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fedd6-d618-4573-9c1a-f4be3482288c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:00.856113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fedd6-d618-4573-9c1a-f4be3482288c None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:00.857571 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 52/98] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:00.863900 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7271-6ae4-42cc-aa38-7a8f2d90a73e None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:00.864419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7271-6ae4-42cc-aa38-7a8f2d90a73e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:00.864494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7271-6ae4-42cc-aa38-7a8f2d90a73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:00.899333 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-3cdf7271-6ae4-42cc-aa38-7a8f2d90a73e None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:00.900650 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-3cdf7271-6ae4-42cc-aa38-7a8f2d90a73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:00.991099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 47/99] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:01.029717 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fedd6-d618-4573-9c1a-f4be3482288c None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:01.150030 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:01.158452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fedd6-d618-4573-9c1a-f4be3482288c None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:01.202637 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:01.203326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:01.203615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:01.203894 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:01.220448 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:01.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:01.226944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:01.227761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 53/100] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:01.233513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7271-6ae4-42cc-aa38-7a8f2d90a73e None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:01.333958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:01.382541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7271-6ae4-42cc-aa38-7a8f2d90a73e None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:01.433265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:01.434177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:01.434458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:01.434735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:01.435462 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:01.435847 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:01.437250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:01.450598 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 48/101] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:01.456340 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:01.580763 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090f79d-2b1f-435b-91ef-63d40d707e59 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:01.624435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06483ec-d63a-4c77-9d4c-7fabbb654469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:01.625001 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06483ec-d63a-4c77-9d4c-7fabbb654469 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:01.625284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06483ec-d63a-4c77-9d4c-7fabbb654469 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:01.625563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06483ec-d63a-4c77-9d4c-7fabbb654469 None admin] PATH_INFO: `/v3/users/0d037e5e61144eb08aee9bca31aeca2a` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:01.641117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06483ec-d63a-4c77-9d4c-7fabbb654469 None admin] RBAC: Authorizing `identity:get_user(user_id=0d037e5e61144eb08aee9bca31aeca2a)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:01.642619 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06483ec-d63a-4c77-9d4c-7fabbb654469 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:01.644628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 54/102] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:01 2022] GET /identity/v3/users/0d037e5e61144eb08aee9bca31aeca2a => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:01.650224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:01.812157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c45d65-6b0a-44c4-932f-608e42b5e298 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:01.866467 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:01.873160 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b35de3-e304-4004-8ab0-29e00286c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:01.874047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35de3-e304-4004-8ab0-29e00286c790 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:01.874573 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35de3-e304-4004-8ab0-29e00286c790 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:01.874795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35de3-e304-4004-8ab0-29e00286c790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:01.961929 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35de3-e304-4004-8ab0-29e00286c790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:01.963553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35de3-e304-4004-8ab0-29e00286c790 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:02.052528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc7a1-edc5-4860-aa7c-bbda9bfaedf8 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.053065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc7a1-edc5-4860-aa7c-bbda9bfaedf8 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.053065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc7a1-edc5-4860-aa7c-bbda9bfaedf8 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.054476 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 55/103] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:02.061975 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42192-ac48-463a-9f1a-c21fe9374c25 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.062265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42192-ac48-463a-9f1a-c21fe9374c25 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.062523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42192-ac48-463a-9f1a-c21fe9374c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.087267 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-b0a42192-ac48-463a-9f1a-c21fe9374c25 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:02.088685 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-b0a42192-ac48-463a-9f1a-c21fe9374c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:02.100032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:02.111145 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 49/104] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:02.112444 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098757-650a-4936-aa1a-9314727fde09 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.112734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098757-650a-4936-aa1a-9314727fde09 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.113011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098757-650a-4936-aa1a-9314727fde09 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.114311 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 50/105] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:02.119839 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305474e9-c782-4f58-b1d1-bf1c1a010d12 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.120123 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305474e9-c782-4f58-b1d1-bf1c1a010d12 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.120404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305474e9-c782-4f58-b1d1-bf1c1a010d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.154759 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-305474e9-c782-4f58-b1d1-bf1c1a010d12 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:02.155980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-305474e9-c782-4f58-b1d1-bf1c1a010d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:02.178388 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 56/106] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:02.179417 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a42192-ac48-463a-9f1a-c21fe9374c25 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:02.211439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:02.294421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a42192-ac48-463a-9f1a-c21fe9374c25 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:02.316516 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 51/107] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:02.317392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305474e9-c782-4f58-b1d1-bf1c1a010d12 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:02.332802 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:02.333952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.334492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.334959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.336401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:02.338213 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:02.340602 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 57/108] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:02 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:02.346984 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:02.361349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:02.450778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305474e9-c782-4f58-b1d1-bf1c1a010d12 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:02.462048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3cda8-1b19-4e64-9dbd-c044212f6d07 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:02.488744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:02.489353 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.489654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.489943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.491141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:02.492592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:02.494657 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 52/109] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:02.495275 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:02.503718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7bec1-db44-414d-9655-db9fc60fcf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:02.504670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7bec1-db44-414d-9655-db9fc60fcf4b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.505152 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7bec1-db44-414d-9655-db9fc60fcf4b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.505626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7bec1-db44-414d-9655-db9fc60fcf4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.506632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7bec1-db44-414d-9655-db9fc60fcf4b None admin] RBAC: Adding query filter params (role.id=9ad57f42e0174b04948f81a6e5d2b496, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=0d037e5e61144eb08aee9bca31aeca2a) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:02.507148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7bec1-db44-414d-9655-db9fc60fcf4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:02.508814 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7bec1-db44-414d-9655-db9fc60fcf4b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:02.515457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 58/110] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:02 2022] GET /identity/v3/role_assignments?user.id=0d037e5e61144eb08aee9bca31aeca2a&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=9ad57f42e0174b04948f81a6e5d2b496 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:02.525870 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388eaf9-789a-4822-a725-87c91d92083a None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.526647 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388eaf9-789a-4822-a725-87c91d92083a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.528010 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388eaf9-789a-4822-a725-87c91d92083a None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.529722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 59/111] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:02.530169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:02.530892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388eaf9-789a-4822-a725-87c91d92083a None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:02.621737 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3109d-33a1-4440-9599-275d6c69a3dc None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:02.651492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71dbbe-ac0d-4ffa-855d-31a6970c02db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:02.652259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71dbbe-ac0d-4ffa-855d-31a6970c02db None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.652475 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71dbbe-ac0d-4ffa-855d-31a6970c02db None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.652758 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71dbbe-ac0d-4ffa-855d-31a6970c02db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.665296 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71dbbe-ac0d-4ffa-855d-31a6970c02db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-8f71dbbe-ac0d-4ffa-855d-31a6970c02db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:02.681679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:02.682641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 53/112] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:02.684325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60caac-880f-4230-a0ff-d9a29e8bcd21 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.685020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60caac-880f-4230-a0ff-d9a29e8bcd21 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.685020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60caac-880f-4230-a0ff-d9a29e8bcd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.691004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:02.703317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-cd60caac-880f-4230-a0ff-d9a29e8bcd21 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:02.704495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-cd60caac-880f-4230-a0ff-d9a29e8bcd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:02.751691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388eaf9-789a-4822-a725-87c91d92083a None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:02.796892 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 54/113] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:02.797950 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60caac-880f-4230-a0ff-d9a29e8bcd21 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:02.820870 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886622-0286-433e-959d-0188170142d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:02.821914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886622-0286-433e-959d-0188170142d0 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:02.822403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886622-0286-433e-959d-0188170142d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:02.822903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886622-0286-433e-959d-0188170142d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:02.824369 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b886622-0286-433e-959d-0188170142d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:02.826253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b886622-0286-433e-959d-0188170142d0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:02.834096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:02.877920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 60/114] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:09:02 2022] POST /identity/v3/projects => generated 302 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:02.881779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886622-0286-433e-959d-0188170142d0 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:02.947485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60caac-880f-4230-a0ff-d9a29e8bcd21 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:02.999884 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6297f-0ba0-42fa-a9ce-644abc45c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.000782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6297f-0ba0-42fa-a9ce-644abc45c556 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.001274 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6297f-0ba0-42fa-a9ce-644abc45c556 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.001718 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6297f-0ba0-42fa-a9ce-644abc45c556 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.003188 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6297f-0ba0-42fa-a9ce-644abc45c556 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:03.003946 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6297f-0ba0-42fa-a9ce-644abc45c556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:03.005603 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6297f-0ba0-42fa-a9ce-644abc45c556 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:03.017570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 55/115] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:03.020300 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26656c-970f-4777-b710-fb924111b3ec None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.020782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26656c-970f-4777-b710-fb924111b3ec None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.021348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26656c-970f-4777-b710-fb924111b3ec None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.022975 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 56/116] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:03.024060 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26656c-970f-4777-b710-fb924111b3ec None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.089004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886622-0286-433e-959d-0188170142d0 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.140609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:03.157386 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20308364-b82f-4fd2-b716-cc4c4e40b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.158442 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308364-b82f-4fd2-b716-cc4c4e40b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.158920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308364-b82f-4fd2-b716-cc4c4e40b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.159384 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308364-b82f-4fd2-b716-cc4c4e40b3b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.172239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20308364-b82f-4fd2-b716-cc4c4e40b3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-20308364-b82f-4fd2-b716-cc4c4e40b3b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:03.178230 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:03.179081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:03.179837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:03.182440 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 61/117] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:03.184628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed004-8a33-4cd9-84a0-887644f68a9e None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.185139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed004-8a33-4cd9-84a0-887644f68a9e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.185637 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed004-8a33-4cd9-84a0-887644f68a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.185841 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:03.207167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-8f8ed004-8a33-4cd9-84a0-887644f68a9e None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:03.208560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-8f8ed004-8a33-4cd9-84a0-887644f68a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:03.218288 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26656c-970f-4777-b710-fb924111b3ec None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.267347 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.267927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.268207 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.268481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] PATH_INFO: `/v3/users/9411e66c17864f3a88f0f7077545cca2` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.270968 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] RBAC: Authorizing `identity:get_user(user_id=9411e66c17864f3a88f0f7077545cca2)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:03.271170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:03.275309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 57/118] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:03 2022] GET /identity/v3/users/9411e66c17864f3a88f0f7077545cca2 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:03.275309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.297056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 62/119] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:03.298718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d552f-c084-42fa-9220-93900bce828b None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.299015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d552f-c084-42fa-9220-93900bce828b None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.299294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d552f-c084-42fa-9220-93900bce828b None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.300920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 63/120] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:03.301755 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d552f-c084-42fa-9220-93900bce828b None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.414844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6381c2f-6a98-47c1-a863-1a1a902847e8 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.425166 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d552f-c084-42fa-9220-93900bce828b None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.450996 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:03.462930 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb84701-55ca-42a4-a5c4-52369b56281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.463764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb84701-55ca-42a4-a5c4-52369b56281c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.464181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb84701-55ca-42a4-a5c4-52369b56281c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.464581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb84701-55ca-42a4-a5c4-52369b56281c None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.465325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb84701-55ca-42a4-a5c4-52369b56281c None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:03.465633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb84701-55ca-42a4-a5c4-52369b56281c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:03.467496 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb84701-55ca-42a4-a5c4-52369b56281c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:03.476831 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 58/121] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:03.477375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.478195 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a0442-19d0-4347-a034-cef14a9bdb22 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.478489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a0442-19d0-4347-a034-cef14a9bdb22 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.478768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a0442-19d0-4347-a034-cef14a9bdb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.478986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.479444 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.479952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.482190 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:03.483980 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:03.486634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 64/122] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:03 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:03.487321 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.505396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-588a0442-19d0-4347-a034-cef14a9bdb22 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:03.507084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-588a0442-19d0-4347-a034-cef14a9bdb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:03.510106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:03.597710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 59/123] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:03.598904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a0442-19d0-4347-a034-cef14a9bdb22 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.641375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9e54d-6e9d-4492-8f33-f4e16dd1daa3 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.679484 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.680136 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.680499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.680677 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.695877 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:03.702296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:03.703186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:03.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 65/124] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:03.704601 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.731231 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a0442-19d0-4347-a034-cef14a9bdb22 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.779579 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.780638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.781060 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.781970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.784045 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:03.785762 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:03.785986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:03.792182 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 60/125] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:03 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:03.793330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.803131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:03.832523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15188e6b-f02c-4d7e-9f4c-258a97d6c5ad None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.881833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.882853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.883349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.883833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/9411e66c17864f3a88f0f7077545cca2/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:03.888160 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] RBAC: Authorizing `identity:create_grant(project_id=646c8e6add7647f0b9cd0c71b8453213, user_id=9411e66c17864f3a88f0f7077545cca2, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:03.889973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:03.909155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 66/126] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:03 2022] PUT /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/9411e66c17864f3a88f0f7077545cca2/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:03.910735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:03.924088 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66dc89-1ac6-4686-96b9-3f36956db7b5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:03.966104 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:03.966845 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:03.967117 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:03.967402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.006393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:04.015415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:04.016592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 61/127] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:04.017541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.083673 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab7bb-4087-4691-8f0b-ae0d29e5527d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:04.090034 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:04.154635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:04.156284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:04.156946 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:04.157226 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:04.157500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.158279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] RBAC: Adding query filter params (name=member) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:04.158567 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:04.161844 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:04.172073 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 67/128] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:04.173214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.216465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c099e9-29fe-422e-8009-dd35bfe1071b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:04.262662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:04.263384 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:04.263674 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:04.263957 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.265311 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:04.266822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:04.268844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 62/129] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:04 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:04.269675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.299529 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5c62-f3e8-4eda-bfc9-c1d10007ba16 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:04.347456 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:04.348131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:04.348730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:04.349025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.349840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:04.350355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:04.352706 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:04.364081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 68/130] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:04.364962 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.400210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429293-2636-49a0-a5e3-2a7f1fa7903f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:04.403290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:04.451220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:04.451807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:04.452093 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:04.452550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.454424 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:04.455927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:04.457680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 63/131] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:04 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:04.458644 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.461808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:04.525020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c3410-4c60-4b7e-9a18-ab75164b3286 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:04.586416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:04.587117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:04.587408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:04.587694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/b49cb583333c4029958b28bd0ef12234/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.589971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] RBAC: Authorizing `identity:create_grant(project_id=646c8e6add7647f0b9cd0c71b8453213, user_id=b49cb583333c4029958b28bd0ef12234, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:04.591783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:04.617823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 69/132] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:04 2022] PUT /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/b49cb583333c4029958b28bd0ef12234/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:04.618852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.700701 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba999b68-96c1-4da6-b1c9-3a335c536fea None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:04.771430 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:04.772114 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:04.772403 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:04.772686 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.779559 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:04.781209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:04.783031 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 64/133] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:04 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:04.789998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.846092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:04.880612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020520-02ac-499f-8611-0eff9940d77b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:04.915473 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:04.954299 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:04.954965 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:04.955250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:04.955531 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] PATH_INFO: `/v3/projects/8791970225dc4c87a289b6e5da8607e2` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:04.957936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] RBAC: Authorizing `identity:get_project(project_id=8791970225dc4c87a289b6e5da8607e2)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:04.959385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:04.961099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 70/134] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:04 2022] GET /identity/v3/projects/8791970225dc4c87a289b6e5da8607e2 => generated 312 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:04.969265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:04.984048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c8012-1ac8-4c10-8d02-21b41d4fa1d7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:05.050923 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:05.051505 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:05.051789 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:05.052064 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:05.054676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:05.057024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:05.059765 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 65/135] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:04 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:05.066798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:05.134024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10b5c-a193-4bd0-977d-921c57b0f933 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:05.190004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf01d9-e59f-4da1-a642-e23e94e3d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:05.190708 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf01d9-e59f-4da1-a642-e23e94e3d4bd None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:05.190994 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf01d9-e59f-4da1-a642-e23e94e3d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:05.191274 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf01d9-e59f-4da1-a642-e23e94e3d4bd None admin] PATH_INFO: `/v3/projects/8791970225dc4c87a289b6e5da8607e2/users/b49cb583333c4029958b28bd0ef12234/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:05.195929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf01d9-e59f-4da1-a642-e23e94e3d4bd None admin] RBAC: Authorizing `identity:create_grant(project_id=8791970225dc4c87a289b6e5da8607e2, user_id=b49cb583333c4029958b28bd0ef12234, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:05.197419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf01d9-e59f-4da1-a642-e23e94e3d4bd None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:05.240535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 71/136] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:04 2022] PUT /identity/v3/projects/8791970225dc4c87a289b6e5da8607e2/users/b49cb583333c4029958b28bd0ef12234/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:05.276629 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb7ff-19b0-40f2-965d-351588d70de8 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:05.338712 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed07e2c-77d2-4982-9160-9f7b8bfb5b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:05.340157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07e2c-77d2-4982-9160-9f7b8bfb5b0f None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:05.340454 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07e2c-77d2-4982-9160-9f7b8bfb5b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:05.340741 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07e2c-77d2-4982-9160-9f7b8bfb5b0f None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/b49cb583333c4029958b28bd0ef12234/roles/438e6120d45e41cb9ae73ac4bdd1750d` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:05.347782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed07e2c-77d2-4982-9160-9f7b8bfb5b0f None admin] RBAC: Authorizing `identity:create_grant(project_id=646c8e6add7647f0b9cd0c71b8453213, user_id=b49cb583333c4029958b28bd0ef12234, role_id=438e6120d45e41cb9ae73ac4bdd1750d)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:05.349281 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed07e2c-77d2-4982-9160-9f7b8bfb5b0f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:05.370299 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:05.377117 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 66/137] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:05 2022] PUT /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/b49cb583333c4029958b28bd0ef12234/roles/438e6120d45e41cb9ae73ac4bdd1750d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:05.564108 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e506f3-d6bc-4015-a269-19d370931b49 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:05.564526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e506f3-d6bc-4015-a269-19d370931b49 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:05.564691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e506f3-d6bc-4015-a269-19d370931b49 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:05.566554 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 72/138] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:05.573473 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8df6-838d-4a53-ab63-231971b01fd0 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:05.574597 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8df6-838d-4a53-ab63-231971b01fd0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:05.575113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8df6-838d-4a53-ab63-231971b01fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:05.607506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-5edc8df6-838d-4a53-ab63-231971b01fd0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:05.608631 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-5edc8df6-838d-4a53-ab63-231971b01fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:05.702197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 67/139] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:05.738304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e506f3-d6bc-4015-a269-19d370931b49 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:05.773988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:05.883475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e506f3-d6bc-4015-a269-19d370931b49 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:05.928853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0ae1e-defe-4409-9071-74446e674d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:05.929518 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ae1e-defe-4409-9071-74446e674d9a None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:05.929834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ae1e-defe-4409-9071-74446e674d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:05.930112 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ae1e-defe-4409-9071-74446e674d9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:05.947199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0ae1e-defe-4409-9071-74446e674d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-98b0ae1e-defe-4409-9071-74446e674d9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:05.952906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:05.953775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:05.954547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 73/140] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:05.960023 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8df6-838d-4a53-ab63-231971b01fd0 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:05.996668 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70735478-1db6-4622-8ab2-93fb3e6d99b8 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:05.997110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70735478-1db6-4622-8ab2-93fb3e6d99b8 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:05.997401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70735478-1db6-4622-8ab2-93fb3e6d99b8 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:05.999004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 74/141] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:06.004463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234f55-36ae-4069-8510-7ba777c4ffc2 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:06.004757 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234f55-36ae-4069-8510-7ba777c4ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:06.005040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40234f55-36ae-4069-8510-7ba777c4ffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:06.043441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-40234f55-36ae-4069-8510-7ba777c4ffc2 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:06.044530 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-40234f55-36ae-4069-8510-7ba777c4ffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:06.144350 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 75/142] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:06.174015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8df6-838d-4a53-ab63-231971b01fd0 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:06.204060 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40234f55-36ae-4069-8510-7ba777c4ffc2 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:06.218122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:06.225247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:06.238015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:06.238655 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:06.238938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:06.239216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:06.239937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:06.240246 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:06.241628 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:06.255487 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 68/143] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:06.274731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:06.435877 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40234f55-36ae-4069-8510-7ba777c4ffc2 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:06.440224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce51c-3bb8-47df-9db9-b3df43172375 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:06.490015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:06.490673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:06.490959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:06.491245 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] PATH_INFO: `/v3/users/0d037e5e61144eb08aee9bca31aeca2a` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:06.498435 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] RBAC: Authorizing `identity:get_user(user_id=0d037e5e61144eb08aee9bca31aeca2a)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:06.499939 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:06.501639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 69/144] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:06 2022] GET /identity/v3/users/0d037e5e61144eb08aee9bca31aeca2a => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:06.507804 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:06.508052 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:06.509018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:06.509492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:06.509970 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:06.512009 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:06.518466 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:06.520467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 76/145] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:06.526304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:06.616986 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:06.711942 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:06.715999 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a1043-f6ff-46d3-aefb-83b3f11e9119 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:06.765006 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ffa5b-4fd0-484e-b494-9749041a81b7 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:06.782634 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758febd-55d6-4358-920d-da277977e012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:06.783321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758febd-55d6-4358-920d-da277977e012 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:06.783604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758febd-55d6-4358-920d-da277977e012 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:06.783876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758febd-55d6-4358-920d-da277977e012 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:06.786991 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758febd-55d6-4358-920d-da277977e012 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:06.788470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758febd-55d6-4358-920d-da277977e012 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:06.793194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 70/146] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:06 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:06.800853 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758febd-55d6-4358-920d-da277977e012 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:06.834595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580749a4-d928-4380-8d12-3639db39cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:06.835223 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580749a4-d928-4380-8d12-3639db39cea6 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:06.835500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580749a4-d928-4380-8d12-3639db39cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:06.835771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580749a4-d928-4380-8d12-3639db39cea6 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:06.836458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580749a4-d928-4380-8d12-3639db39cea6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:06.837952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580749a4-d928-4380-8d12-3639db39cea6 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:06.875386 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 77/147] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:06 2022] POST /identity/v3/users => generated 283 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:09:06.965247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758febd-55d6-4358-920d-da277977e012 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:06.995103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:07.005088 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf012ac-caaf-4c2d-aef1-7296a465eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:07.005802 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf012ac-caaf-4c2d-aef1-7296a465eeef None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:07.006087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf012ac-caaf-4c2d-aef1-7296a465eeef None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:07.006360 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf012ac-caaf-4c2d-aef1-7296a465eeef None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/0d037e5e61144eb08aee9bca31aeca2a/roles/9ad57f42e0174b04948f81a6e5d2b496` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:07.008469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf012ac-caaf-4c2d-aef1-7296a465eeef None admin] RBAC: Authorizing `identity:create_grant(project_id=646c8e6add7647f0b9cd0c71b8453213, user_id=0d037e5e61144eb08aee9bca31aeca2a, role_id=9ad57f42e0174b04948f81a6e5d2b496)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:07.009959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf012ac-caaf-4c2d-aef1-7296a465eeef None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:07.033010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 71/148] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:06 2022] PUT /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213/users/0d037e5e61144eb08aee9bca31aeca2a/roles/9ad57f42e0174b04948f81a6e5d2b496 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:07.366495 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8762e-4ff9-4698-9ff0-63e9763e3c20 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:07.367470 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8762e-4ff9-4698-9ff0-63e9763e3c20 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:07.367953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8762e-4ff9-4698-9ff0-63e9763e3c20 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:07.369820 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 78/149] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:07.376749 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df149e9-1a3a-42cd-93d8-28e47ff1d0ce None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:07.377244 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df149e9-1a3a-42cd-93d8-28e47ff1d0ce None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:07.377438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df149e9-1a3a-42cd-93d8-28e47ff1d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:07.403026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-8df149e9-1a3a-42cd-93d8-28e47ff1d0ce None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:07.404230 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-8df149e9-1a3a-42cd-93d8-28e47ff1d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:07.506047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 72/150] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:07.551153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8762e-4ff9-4698-9ff0-63e9763e3c20 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:07.701636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8762e-4ff9-4698-9ff0-63e9763e3c20 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:07.741946 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:07.749320 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:07.750062 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:07.750348 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:07.750628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:07.769953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:07.774890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:07.775759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:07.777539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 79/151] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:07.784351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df149e9-1a3a-42cd-93d8-28e47ff1d0ce None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:07.939670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df149e9-1a3a-42cd-93d8-28e47ff1d0ce None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:07.970122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:07.978610 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d4ab-8094-4781-a787-b9ecf5750dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:07.979642 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d4ab-8094-4781-a787-b9ecf5750dd6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:07.980556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d4ab-8094-4781-a787-b9ecf5750dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:07.981047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d4ab-8094-4781-a787-b9ecf5750dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:07.981857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d4ab-8094-4781-a787-b9ecf5750dd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:07.982437 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d4ab-8094-4781-a787-b9ecf5750dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:07.984002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d4ab-8094-4781-a787-b9ecf5750dd6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:07.994461 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 73/152] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:08.000629 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:08.057980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616b59-2edd-4094-b61d-d9c1eab32d41 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:08.058677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616b59-2edd-4094-b61d-d9c1eab32d41 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:08.059254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616b59-2edd-4094-b61d-d9c1eab32d41 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:08.061150 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 74/153] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:08.071852 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe639-42b6-4796-8c32-e60bb65aa8dd None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:08.072725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe639-42b6-4796-8c32-e60bb65aa8dd None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:08.075086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe639-42b6-4796-8c32-e60bb65aa8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:08.108419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-935fe639-42b6-4796-8c32-e60bb65aa8dd None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:08.111193 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-935fe639-42b6-4796-8c32-e60bb65aa8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:08.191065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4349-0d32-4cce-a1b7-9c20e4c69d47 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:08.231678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 75/154] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:08.255085 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:08.256168 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:08.256661 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:08.257128 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] PATH_INFO: `/v3/users/9411e66c17864f3a88f0f7077545cca2` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:08.259500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] RBAC: Authorizing `identity:get_user(user_id=9411e66c17864f3a88f0f7077545cca2)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:08.261886 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:08.263867 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 80/155] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:07 2022] GET /identity/v3/users/9411e66c17864f3a88f0f7077545cca2 => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:08.269623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe639-42b6-4796-8c32-e60bb65aa8dd None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:08.347050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:08.390438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe639-42b6-4796-8c32-e60bb65aa8dd None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:08.402556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:08.431135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:08.432163 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:08.432659 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:08.433199 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:08.460162 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:08.521924 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:08.524534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:08.541405 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138724a-7bc7-4259-bb51-aa192768b53d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:08.612899 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:08.613998 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:08.614474 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:08.614938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:08.640495 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:08.647734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:08.648918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:08.649722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:08.655287 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 81/156] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:08.700579 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:08.737242 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 76/157] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:08.743245 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:08.759739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:08.921433 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55618f0-8a5a-4085-8765-b59947b0e4d7 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:08.943523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:08.967751 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455565-d98b-4f24-90b8-feb5244fbe72 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:08.973719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:08.974645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:08.975136 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:08.975545 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:08.976409 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] RBAC: Adding query filter params (name=member) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:08.976849 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:08.979028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:08.994557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 82/158] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:09.001987 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:09.059361 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:09.060393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.060393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.060683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.062021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:09.063498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:09.065394 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 77/159] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:08 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:09.071213 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:09.175376 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974717-3abe-432f-b3b6-455a13a3130a None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:09.267735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:09.279004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:09.279719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.280005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.280286 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.286631 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:09.288131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:09.290017 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 83/160] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:09 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:09.296914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:09.328992 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb6b4b-cf88-40ce-8258-ac9578a041b6 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:09.403283 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabc8f3-b54d-4a0a-94d5-6c729fd22e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:09.404768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabc8f3-b54d-4a0a-94d5-6c729fd22e3b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.405245 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabc8f3-b54d-4a0a-94d5-6c729fd22e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.405743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabc8f3-b54d-4a0a-94d5-6c729fd22e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.406739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabc8f3-b54d-4a0a-94d5-6c729fd22e3b None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=9411e66c17864f3a88f0f7077545cca2) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:09.407266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabc8f3-b54d-4a0a-94d5-6c729fd22e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:09.409134 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabc8f3-b54d-4a0a-94d5-6c729fd22e3b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:09.422120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 78/161] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:09 2022] GET /identity/v3/role_assignments?user.id=9411e66c17864f3a88f0f7077545cca2&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=40fb60241dc645059f308de1b41e6e44 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:09.423638 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:09.425320 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463851c-0219-4e2c-a172-4194e4a3549b None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.425979 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463851c-0219-4e2c-a172-4194e4a3549b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.426552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463851c-0219-4e2c-a172-4194e4a3549b None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.428458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 79/162] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:09.436352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d844-b956-44d8-8856-c1667c8a0c95 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.436958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d844-b956-44d8-8856-c1667c8a0c95 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.437596 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d844-b956-44d8-8856-c1667c8a0c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.465437 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-2d70d844-b956-44d8-8856-c1667c8a0c95 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:09.467120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-2d70d844-b956-44d8-8856-c1667c8a0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:09.556354 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 80/163] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:09.567923 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372415-a848-41ae-a437-1e9db3e58843 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:09.590374 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55054467-e2e0-4b80-849b-f033a5c70a6a None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.591031 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55054467-e2e0-4b80-849b-f033a5c70a6a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.591502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55054467-e2e0-4b80-849b-f033a5c70a6a None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.593150 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 81/164] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:09:09.604162 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55054467-e2e0-4b80-849b-f033a5c70a6a None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:09.646444 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:09.647100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.647384 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.647662 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.721747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:09.766597 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55054467-e2e0-4b80-849b-f033a5c70a6a None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:09.820301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257faf83-d155-4713-a572-35a36a7eaf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:09.821297 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257faf83-d155-4713-a572-35a36a7eaf2c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.821902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257faf83-d155-4713-a572-35a36a7eaf2c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.822371 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257faf83-d155-4713-a572-35a36a7eaf2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.830879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:09.833819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:09.839980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257faf83-d155-4713-a572-35a36a7eaf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-257faf83-d155-4713-a572-35a36a7eaf2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:09.846164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:09.847415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:09.848342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:09.856096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 82/165] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:09.857750 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c1b4-3715-4049-bdab-853dfbae196d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:09.858242 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c1b4-3715-4049-bdab-853dfbae196d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:09.858707 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c1b4-3715-4049-bdab-853dfbae196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:09.887977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-c416c1b4-3715-4049-bdab-853dfbae196d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:09.889522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-c416c1b4-3715-4049-bdab-853dfbae196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:09.938129 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:09.996960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 83/166] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:09.999717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c1b4-3715-4049-bdab-853dfbae196d None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.048327 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 84/167] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 19:09:10.052825 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.142343 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:10.244855 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c1b4-3715-4049-bdab-853dfbae196d None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:10.287889 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87acf8-559f-43a7-9750-1bd2953fb926 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:10.338359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:10.340371 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:10.340852 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:10.341339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:10.342308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:10.342825 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:10.344549 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:10.363423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 84/168] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:10.364605 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.387140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:10.387886 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:10.388173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:10.388439 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:10.407997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:10.412956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:10.413869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:10.414652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:10.422287 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 85/169] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:10.423138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.440682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:10.543555 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710baa51-6f54-481f-ac8d-08b46669d145 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:10.586582 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:10.591817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be3364-f8e6-4d84-9eee-515aa1fb1959 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:10.613524 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:10.614220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:10.614503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:10.614781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:10.618457 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:10.621016 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:10.623061 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 85/170] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:10 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:10.624044 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.633143 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:10.633838 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:10.634118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:10.634392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:10.635591 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:10.637731 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:10.640437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 86/171] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:10 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:10.641233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.762315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b8b56-f9ce-41d4-a080-507483f78555 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:10.787786 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:10.802034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:10.802989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:10.803515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:10.803969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:10.804864 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:10.805357 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:10.807068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:10.817228 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 86/172] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:10.818385 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.842276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3af0-6cc7-4926-9c75-3fbab39a9ec6 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:10.883285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:10.936276 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a1a53-9943-44ab-921e-f3a42066a695 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:10.937311 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:10.938120 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:10.938550 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:10.938780 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:10.940418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=b49cb583333c4029958b28bd0ef12234) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:10.940418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:10.941624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:10.958007 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 87/173] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:10 2022] GET /identity/v3/role_assignments?user.id=b49cb583333c4029958b28bd0ef12234&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:10.959212 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:10.976327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c055b-af35-49d4-b3cf-75f87b6746ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:10.977289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c055b-af35-49d4-b3cf-75f87b6746ce None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:10.977812 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c055b-af35-49d4-b3cf-75f87b6746ce None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:10.978268 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c055b-af35-49d4-b3cf-75f87b6746ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.091728 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c055b-af35-49d4-b3cf-75f87b6746ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:11.094139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c055b-af35-49d4-b3cf-75f87b6746ce None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:11.162831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09ccd-09c2-45f2-bc44-4b54cf12624f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:11.169520 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:11.212311 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5294ba-34c4-40ec-8a9a-bafa880b68a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:11.213352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5294ba-34c4-40ec-8a9a-bafa880b68a5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:11.213909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5294ba-34c4-40ec-8a9a-bafa880b68a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:11.214946 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5294ba-34c4-40ec-8a9a-bafa880b68a5 None admin] PATH_INFO: `/v3/users/b49cb583333c4029958b28bd0ef12234` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.216695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5294ba-34c4-40ec-8a9a-bafa880b68a5 None admin] RBAC: Authorizing `identity:get_user(user_id=b49cb583333c4029958b28bd0ef12234)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:11.219784 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5294ba-34c4-40ec-8a9a-bafa880b68a5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:11.223079 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 88/174] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:10 2022] GET /identity/v3/users/b49cb583333c4029958b28bd0ef12234 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:11.224738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e1d6f-abfb-46f5-844c-71e3b39672de None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:11.227931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e1d6f-abfb-46f5-844c-71e3b39672de None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:11.228232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e1d6f-abfb-46f5-844c-71e3b39672de None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.229691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 89/175] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:11.230882 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e1d6f-abfb-46f5-844c-71e3b39672de None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:11.253009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 87/176] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:11.254763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca39c-6d60-41b0-97e3-056b4ba9d02a None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:11.255261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca39c-6d60-41b0-97e3-056b4ba9d02a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:11.255791 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca39c-6d60-41b0-97e3-056b4ba9d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.257284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:11.277887 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-c9cca39c-6d60-41b0-97e3-056b4ba9d02a None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:11.279423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-c9cca39c-6d60-41b0-97e3-056b4ba9d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:11.415969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 88/177] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:11.416641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca39c-6d60-41b0-97e3-056b4ba9d02a None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:11.445771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e1d6f-abfb-46f5-844c-71e3b39672de None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:11.492677 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:11.494137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:11.494843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:11.495969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.546595 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:11.582504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca39c-6d60-41b0-97e3-056b4ba9d02a None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:11.593629 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:11.595237 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:11.606429 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:11.636807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:11.637854 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:11.638364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:11.638856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] PATH_INFO: `/v3/projects/8791970225dc4c87a289b6e5da8607e2` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.640278 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] RBAC: Authorizing `identity:get_project(project_id=8791970225dc4c87a289b6e5da8607e2)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:11.642087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:11.644148 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 89/178] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:11 2022] GET /identity/v3/projects/8791970225dc4c87a289b6e5da8607e2 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:11.645153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:11.727193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 90/179] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:11.727997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:11.761818 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6de4d-ef1f-459c-80aa-887988088439 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:11.805114 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:11.806285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:11.806774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:11.807266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.819836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:11.826420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:11.827291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:11.828094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:11.830596 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 90/180] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:11.831747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:11.846840 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:11.849332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f35e6-06a9-4a17-ae7a-62873ab577cb None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:11.860022 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:11.889148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:11.889836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:11.890115 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:11.890806 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:11.891274 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=8791970225dc4c87a289b6e5da8607e2, user.id=b49cb583333c4029958b28bd0ef12234) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:11.891638 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:11.893224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:11.900107 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 91/181] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:11 2022] GET /identity/v3/role_assignments?user.id=b49cb583333c4029958b28bd0ef12234&scope.project.id=8791970225dc4c87a289b6e5da8607e2&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:11.900919 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:11.963171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726acac-82f5-4466-8916-b246331eaf4a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.005348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.006522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.007013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.007494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.009208 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:12.011852 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:12.014499 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 91/182] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:11 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:12.023041 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:12.044633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df54d0-05a4-40d2-bb0e-56827a49ce82 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.125778 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c12ad5-4244-4f05-8cbe-e7a89868074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.126652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c12ad5-4244-4f05-8cbe-e7a89868074e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.127034 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c12ad5-4244-4f05-8cbe-e7a89868074e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.127454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c12ad5-4244-4f05-8cbe-e7a89868074e None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.128413 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c12ad5-4244-4f05-8cbe-e7a89868074e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:12.128879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c12ad5-4244-4f05-8cbe-e7a89868074e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:12.131854 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c12ad5-4244-4f05-8cbe-e7a89868074e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:12.150549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 92/183] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:12.155860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26439-ace3-4a07-90c3-90196365e841 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.156412 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26439-ace3-4a07-90c3-90196365e841 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.156900 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26439-ace3-4a07-90c3-90196365e841 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.158592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 93/184] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:12.159542 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c26439-ace3-4a07-90c3-90196365e841 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:12.180190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:12.212780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b756f-d111-497d-8348-1e54aa59d2bc None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.218074 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:12.257447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882a91b-94e2-4efc-9db6-d0323c77c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.264678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882a91b-94e2-4efc-9db6-d0323c77c4fa None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.264678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882a91b-94e2-4efc-9db6-d0323c77c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.264678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882a91b-94e2-4efc-9db6-d0323c77c4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.264678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882a91b-94e2-4efc-9db6-d0323c77c4fa None admin] RBAC: Adding query filter params (role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=b49cb583333c4029958b28bd0ef12234) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:12.264678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882a91b-94e2-4efc-9db6-d0323c77c4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:12.264678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882a91b-94e2-4efc-9db6-d0323c77c4fa None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:12.270800 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 92/185] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:12 2022] GET /identity/v3/role_assignments?user.id=b49cb583333c4029958b28bd0ef12234&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:12.271611 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42ab7-5aef-40e1-8e22-d38fdd0f0126 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.271955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42ab7-5aef-40e1-8e22-d38fdd0f0126 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.272240 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42ab7-5aef-40e1-8e22-d38fdd0f0126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.292998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-78c42ab7-5aef-40e1-8e22-d38fdd0f0126 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:12.294286 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-78c42ab7-5aef-40e1-8e22-d38fdd0f0126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:12.315941 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c26439-ace3-4a07-90c3-90196365e841 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.359039 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbafc5e-4a39-4029-8cfb-be80570e6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.360206 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafc5e-4a39-4029-8cfb-be80570e6b40 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.360691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafc5e-4a39-4029-8cfb-be80570e6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.361174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafc5e-4a39-4029-8cfb-be80570e6b40 None admin] PATH_INFO: `/v3/users/0d037e5e61144eb08aee9bca31aeca2a` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.362667 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbafc5e-4a39-4029-8cfb-be80570e6b40 None admin] RBAC: Authorizing `identity:get_user(user_id=0d037e5e61144eb08aee9bca31aeca2a)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:12.364526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbafc5e-4a39-4029-8cfb-be80570e6b40 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:12.367058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 94/186] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:12 2022] GET /identity/v3/users/0d037e5e61144eb08aee9bca31aeca2a => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:12.370040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd89a8-3a51-4014-a6e0-c9a402951ea0 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.371451 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd89a8-3a51-4014-a6e0-c9a402951ea0 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.372011 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd89a8-3a51-4014-a6e0-c9a402951ea0 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.374078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 95/187] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:12.380937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46403-6b9f-49a9-ab90-9287af44880b None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.381228 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46403-6b9f-49a9-ab90-9287af44880b None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.381509 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46403-6b9f-49a9-ab90-9287af44880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.391705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 93/188] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:12.392403 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c42ab7-5aef-40e1-8e22-d38fdd0f0126 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:12.405201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-38c46403-6b9f-49a9-ab90-9287af44880b None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:12.406917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-38c46403-6b9f-49a9-ab90-9287af44880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:12.504087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:12.509986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 96/189] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:12.510887 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c46403-6b9f-49a9-ab90-9287af44880b None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:12.537794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c42ab7-5aef-40e1-8e22-d38fdd0f0126 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.552175 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:12.589051 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96880a-cca3-43fc-8be0-6b416a79b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.589798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96880a-cca3-43fc-8be0-6b416a79b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.589998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96880a-cca3-43fc-8be0-6b416a79b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.590275 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96880a-cca3-43fc-8be0-6b416a79b7d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.647812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c46403-6b9f-49a9-ab90-9287af44880b None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.668540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96880a-cca3-43fc-8be0-6b416a79b7d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:12.670141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96880a-cca3-43fc-8be0-6b416a79b7d5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:12.685505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.686192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.686467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.686737 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.698106 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:12.703198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:12.704603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 97/190] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:12.705467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:12.748743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:12.780857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 94/191] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:12.782086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a88cff-876b-4a39-a079-8b6f0e706741 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.782380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a88cff-876b-4a39-a079-8b6f0e706741 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.782658 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a88cff-876b-4a39-a079-8b6f0e706741 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.783936 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 95/192] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:12.784634 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a88cff-876b-4a39-a079-8b6f0e706741 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:12.805330 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:12.814677 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcb1b4-8bf1-48bd-81a5-887f392de021 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.853434 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.854127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.854404 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.855339 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.866459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:12.871734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:12.872842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:12.873721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 98/193] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:12.874511 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:12.897341 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a88cff-876b-4a39-a079-8b6f0e706741 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.934276 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b726752-46d6-47e2-8e1c-8df33fa30d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:12.934901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b726752-46d6-47e2-8e1c-8df33fa30d0c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.935182 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b726752-46d6-47e2-8e1c-8df33fa30d0c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.935461 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b726752-46d6-47e2-8e1c-8df33fa30d0c None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.936181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b726752-46d6-47e2-8e1c-8df33fa30d0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:12.936484 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b726752-46d6-47e2-8e1c-8df33fa30d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:12.937888 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b726752-46d6-47e2-8e1c-8df33fa30d0c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:12.946133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 96/194] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:12.947375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45061-9edb-46b2-b04a-dd242240558f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:12.947702 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45061-9edb-46b2-b04a-dd242240558f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:12.947981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45061-9edb-46b2-b04a-dd242240558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:12.967182 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-42a45061-9edb-46b2-b04a-dd242240558f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:12.968416 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-42a45061-9edb-46b2-b04a-dd242240558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:12.981605 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362c87e-113a-4995-a680-f808d46e89ad None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:12.996872 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.015932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.016582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.016867 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.017146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.018353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.019891 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.021571 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 99/195] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:12 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:13.022389 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.044535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.045161 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 97/196] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:13.046040 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a45061-9edb-46b2-b04a-dd242240558f None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.125628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e124-f64b-4ae0-9e00-aab3ace25984 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.162931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.163552 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.163831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.164101 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.164306 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a45061-9edb-46b2-b04a-dd242240558f None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.164816 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:13.165118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.166518 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.175916 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 100/197] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:13.181337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.201266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.201990 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.202222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.202491 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] PATH_INFO: `/v3/users/3835f7fe43454f74b676df5a9eb7b7f3` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.218653 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] RBAC: Authorizing `identity:get_user(user_id=3835f7fe43454f74b676df5a9eb7b7f3)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.220197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.221955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 98/198] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/users/3835f7fe43454f74b676df5a9eb7b7f3 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:13.222787 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.248896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.266452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.286533 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd0ca-068f-418b-973a-aa978506dcc1 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.327438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.327987 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.328270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.328549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.329367 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] RBAC: Adding query filter params (role.id=9ad57f42e0174b04948f81a6e5d2b496, scope.project.id=646c8e6add7647f0b9cd0c71b8453213, user.id=0d037e5e61144eb08aee9bca31aeca2a) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:13.329714 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.331259 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.338141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 101/199] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/role_assignments?user.id=0d037e5e61144eb08aee9bca31aeca2a&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=9ad57f42e0174b04948f81a6e5d2b496 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:13.350022 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.462172 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05698b-1745-498b-9647-83a40784d90a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.464869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f73168-f9ca-4a85-a051-db09a42273e2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.503974 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.504648 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.504938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.505204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.506545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.508037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.509791 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 99/200] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:13.510719 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.518059 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.518994 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.520218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.520515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] PATH_INFO: `/v3/users/3835f7fe43454f74b676df5a9eb7b7f3` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.521861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] RBAC: Authorizing `identity:get_user(user_id=3835f7fe43454f74b676df5a9eb7b7f3)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.523663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.525723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 102/201] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/users/3835f7fe43454f74b676df5a9eb7b7f3 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:13.527861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.546497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.629340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.640172 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dff0cc-c097-4554-b60c-8452628c1e19 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.652017 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81f38a-1f2d-4a07-bce2-e47fd931981e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.676022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.676732 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.677012 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.677282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.688618 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.689250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.689523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.689828 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.690528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.691994 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.720148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 103/202] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:13 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:13.720993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.766259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.768187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:13.818873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.859846 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf957-d2f7-4ea9-a4bb-ec6fe589a12e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:13.881976 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:13.894795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 100/203] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:13.900609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:13.903627 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:13.904452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:13.904737 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:13.905019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:13.988105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:13.989581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:14.031904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1688026-a214-4296-83a9-ab70ef3f715f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:14.077338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:14.077753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:14.078454 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:14.078736 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:14.079010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:14.080524 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:14.082345 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:14.084278 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 101/204] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:14.092428 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:14.123937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 104/205] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:14.129939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:14.169139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:14.223250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbee1e-f8af-4971-9e3b-eead227f22b7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:14.269502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:14.270450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:14.270742 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:14.271017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:14.271819 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=3835f7fe43454f74b676df5a9eb7b7f3) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:14.272123 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:14.273451 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172accd4-95aa-40a9-8906-05d5107e8527 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:14.273577 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:14.293677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 102/206] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:14 2022] GET /identity/v3/role_assignments?user.id=3835f7fe43454f74b676df5a9eb7b7f3&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=40fb60241dc645059f308de1b41e6e44 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:14.317892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52283d6e-4b06-47a8-9f45-56cf1c9e171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:14.318569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52283d6e-4b06-47a8-9f45-56cf1c9e171c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:14.318846 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52283d6e-4b06-47a8-9f45-56cf1c9e171c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:14.319119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52283d6e-4b06-47a8-9f45-56cf1c9e171c None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:14.320385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52283d6e-4b06-47a8-9f45-56cf1c9e171c None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:14.321912 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52283d6e-4b06-47a8-9f45-56cf1c9e171c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:14.330013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 105/207] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:14 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:14.331489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:14.454662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6266-7c09-462d-afb8-bc012283f09b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:14.482303 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:14.494953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99584ae2-22a4-4f35-ad7d-d0c40ed9242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:14.496122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99584ae2-22a4-4f35-ad7d-d0c40ed9242c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:14.496401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99584ae2-22a4-4f35-ad7d-d0c40ed9242c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:14.496714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99584ae2-22a4-4f35-ad7d-d0c40ed9242c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:14.497463 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99584ae2-22a4-4f35-ad7d-d0c40ed9242c None admin] RBAC: Adding query filter params (role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=3835f7fe43454f74b676df5a9eb7b7f3) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:14.497817 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99584ae2-22a4-4f35-ad7d-d0c40ed9242c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:14.499247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99584ae2-22a4-4f35-ad7d-d0c40ed9242c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:14.505349 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 103/208] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:14 2022] GET /identity/v3/role_assignments?user.id=3835f7fe43454f74b676df5a9eb7b7f3&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:16.174979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb579-fd29-4556-80be-7a8360bcb3b7 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.175534 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb579-fd29-4556-80be-7a8360bcb3b7 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.175534 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb579-fd29-4556-80be-7a8360bcb3b7 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.177100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 106/209] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:16.183407 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa6e66-daf1-4d74-abcd-ceb6c3bda357 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.183896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa6e66-daf1-4d74-abcd-ceb6c3bda357 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.184013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa6e66-daf1-4d74-abcd-ceb6c3bda357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.203380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-a4fa6e66-daf1-4d74-abcd-ceb6c3bda357 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:16.204569 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a4fa6e66-daf1-4d74-abcd-ceb6c3bda357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:16.259952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3059f-3a0a-42c3-8d53-42ab6291dda9 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.260305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3059f-3a0a-42c3-8d53-42ab6291dda9 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.260499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3059f-3a0a-42c3-8d53-42ab6291dda9 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.262830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 107/210] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:16.268260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5868ec-3401-4b95-81f4-7e45578790cd None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.268543 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5868ec-3401-4b95-81f4-7e45578790cd None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.268822 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5868ec-3401-4b95-81f4-7e45578790cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.281889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 104/211] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:16.293391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-2e5868ec-3401-4b95-81f4-7e45578790cd None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:16.295685 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-2e5868ec-3401-4b95-81f4-7e45578790cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:16.305636 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa6e66-daf1-4d74-abcd-ceb6c3bda357 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:16.334751 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:16.375288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 108/212] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:16.400667 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5868ec-3401-4b95-81f4-7e45578790cd None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:16.425617 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa6e66-daf1-4d74-abcd-ceb6c3bda357 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:16.447575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:16.476144 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:16.477803 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.478275 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.478739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.492381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:16.498794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:16.499769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:16.500581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:16.507898 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 105/213] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:16.509243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:16.515303 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5868ec-3401-4b95-81f4-7e45578790cd None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:16.557107 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:16.558313 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.558591 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.558862 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.560120 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:16.561624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:16.563774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 109/214] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:16.568935 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:16.608449 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:16.624283 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb1b8-c540-46b9-b6ce-a0a08d7aee8d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:16.660305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcb5a0-21ae-4067-9a9f-ffe733f97692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:16.661093 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb5a0-21ae-4067-9a9f-ffe733f97692 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.661202 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb5a0-21ae-4067-9a9f-ffe733f97692 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.661465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb5a0-21ae-4067-9a9f-ffe733f97692 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.662225 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcb5a0-21ae-4067-9a9f-ffe733f97692 None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:16.662628 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcb5a0-21ae-4067-9a9f-ffe733f97692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:16.664690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcb5a0-21ae-4067-9a9f-ffe733f97692 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:16.677201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 106/215] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:16.678979 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36653a-8df5-483b-906f-24727040612a None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.679449 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36653a-8df5-483b-906f-24727040612a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.679830 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36653a-8df5-483b-906f-24727040612a None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.681481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 107/216] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:16.683556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36653a-8df5-483b-906f-24727040612a None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:16.691477 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1f8ca-cedc-4a27-a3e2-d370446e5e92 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:16.735120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:16.746681 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3f0e-105f-4058-9917-a317b8b25378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:16.747309 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3f0e-105f-4058-9917-a317b8b25378 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.747586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3f0e-105f-4058-9917-a317b8b25378 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.747965 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3f0e-105f-4058-9917-a317b8b25378 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.748649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3f0e-105f-4058-9917-a317b8b25378 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:16.750099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3f0e-105f-4058-9917-a317b8b25378 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:16.775868 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 110/217] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:16 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:09:16.778611 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07518033-1aab-4119-8033-5c118a63504d None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.779236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07518033-1aab-4119-8033-5c118a63504d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.779709 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07518033-1aab-4119-8033-5c118a63504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.805519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-07518033-1aab-4119-8033-5c118a63504d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:16.806808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36653a-8df5-483b-906f-24727040612a None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:16.808099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-07518033-1aab-4119-8033-5c118a63504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:16.848424 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e0b6-4e42-49e6-92d4-91eb69e1ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:16.849098 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e0b6-4e42-49e6-92d4-91eb69e1ea74 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.849382 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e0b6-4e42-49e6-92d4-91eb69e1ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.849685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e0b6-4e42-49e6-92d4-91eb69e1ea74 None admin] PATH_INFO: `/v3/users/f586c41d7cb742a7a1c49d54bf135846` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.867327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e0b6-4e42-49e6-92d4-91eb69e1ea74 None admin] RBAC: Authorizing `identity:get_user(user_id=f586c41d7cb742a7a1c49d54bf135846)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:16.869135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e0b6-4e42-49e6-92d4-91eb69e1ea74 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:16.873351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 108/218] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:16 2022] GET /identity/v3/users/f586c41d7cb742a7a1c49d54bf135846 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:16.879523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958255-2a62-4117-acd9-bd5d63059ffe None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.879877 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958255-2a62-4117-acd9-bd5d63059ffe None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.880094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958255-2a62-4117-acd9-bd5d63059ffe None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.881618 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 109/219] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:16.882263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958255-2a62-4117-acd9-bd5d63059ffe None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:16.914398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 111/220] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:16.922802 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e2c8-1aad-4df7-bdde-3800c3044864 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:16.923204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e2c8-1aad-4df7-bdde-3800c3044864 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:16.923485 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92e2c8-1aad-4df7-bdde-3800c3044864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:16.944823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-6d92e2c8-1aad-4df7-bdde-3800c3044864 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:16.946137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-6d92e2c8-1aad-4df7-bdde-3800c3044864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:16.965311 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.006615 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.015372 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958255-2a62-4117-acd9-bd5d63059ffe None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.032931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 112/221] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:17.033724 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92e2c8-1aad-4df7-bdde-3800c3044864 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.056907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.057755 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.058000 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.058287 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.155158 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:17.156637 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:17.162514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92e2c8-1aad-4df7-bdde-3800c3044864 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.209464 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.210972 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.211453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.211922 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.224534 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:17.230075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:17.231091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:17.231913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:17.234531 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 113/222] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:17.235574 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.258322 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.273783 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.284457 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 110/223] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:17.285851 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.360064 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891b07-4ad8-4f32-a91f-fb490f8b2048 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.398354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.399402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.399881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.400350 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.412296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:17.418776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:17.419697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:17.420497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:17.423220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 114/224] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:17.424253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.427670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3457e4e-38bb-4aac-bbdb-a069a511343e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.474459 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.475056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.475343 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.475620 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.476550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:17.476864 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:17.478780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:17.490343 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 111/225] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:17.495237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.510056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.553595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5e1e9-3895-4730-a3fb-2e48a69e2b00 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.567408 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.597549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.598412 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.598795 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.599081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.600448 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:17.602264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:17.605102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 115/226] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:17.605768 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.631192 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08842-5387-48f8-9761-ab6c18439a03 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.670964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.671995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.672478 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.673339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.674363 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:17.674957 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:17.676704 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:17.688357 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 112/227] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:17.689739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.761321 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803cd2-f619-4fae-94ba-65859e572414 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.814201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.814871 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.815157 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.815434 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] PATH_INFO: `/v3/users/3835f7fe43454f74b676df5a9eb7b7f3` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.816707 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] RBAC: Authorizing `identity:get_user(user_id=3835f7fe43454f74b676df5a9eb7b7f3)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:17.818797 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:17.820776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 116/228] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/users/3835f7fe43454f74b676df5a9eb7b7f3 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:17.825436 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.834504 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.843621 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b72dc-bc01-44ff-90bd-8d86a9a0f1a2 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.873301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:17.902633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.903294 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.903583 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.903863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.904774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=f586c41d7cb742a7a1c49d54bf135846) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:17.905103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:17.906752 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:17.913015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 113/229] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/role_assignments?user.id=f586c41d7cb742a7a1c49d54bf135846&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:17.913973 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:17.953498 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de10e5-5780-40d0-975d-0f593a65fb6b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:17.993276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:17.994706 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:17.995828 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:17.996358 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] PATH_INFO: `/v3/users/3835f7fe43454f74b676df5a9eb7b7f3` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:17.997872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] RBAC: Authorizing `identity:get_user(user_id=3835f7fe43454f74b676df5a9eb7b7f3)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:17.999752 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:18.001786 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 117/230] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/users/3835f7fe43454f74b676df5a9eb7b7f3 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:18.011563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:18.036728 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281b3c-99ee-4d57-b139-359d73aa268b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:18.107151 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:18.107823 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:18.108110 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:18.108387 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:18.114533 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:18.116032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:18.118163 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 114/231] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:17 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:18.124444 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:18.150536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:18.203528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8647152-e2ba-4574-b8e8-16da69e7bd46 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:18.205325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:18.271833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:18.274018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:18.274634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:18.275688 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:18.278762 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:18.280567 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:18.283658 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 118/232] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:18 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:18.287612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7cfa-72f6-407f-b34e-5995f98ac46c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:18.290395 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:18.358509 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e1e61-8fcb-4808-8dcc-6b3cd692c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:18.359510 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1e61-8fcb-4808-8dcc-6b3cd692c3c4 None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:18.359936 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1e61-8fcb-4808-8dcc-6b3cd692c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:18.360355 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1e61-8fcb-4808-8dcc-6b3cd692c3c4 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/3835f7fe43454f74b676df5a9eb7b7f3/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:18.362829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e1e61-8fcb-4808-8dcc-6b3cd692c3c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=91ff70ae363b4f6cabed63522d2304e6, user_id=3835f7fe43454f74b676df5a9eb7b7f3, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:18.364537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e1e61-8fcb-4808-8dcc-6b3cd692c3c4 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:18.392467 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 115/233] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:18 2022] PUT /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/3835f7fe43454f74b676df5a9eb7b7f3/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:09:18.470904 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a4dd2-570a-459c-b2ad-50b7a7322ccf None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:18.510177 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a2b5e-45b9-4534-b16c-6c13b44c14b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:18.511757 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2b5e-45b9-4534-b16c-6c13b44c14b9 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:18.512206 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2b5e-45b9-4534-b16c-6c13b44c14b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:18.512616 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2b5e-45b9-4534-b16c-6c13b44c14b9 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/3835f7fe43454f74b676df5a9eb7b7f3/roles/438e6120d45e41cb9ae73ac4bdd1750d` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:18.515093 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a2b5e-45b9-4534-b16c-6c13b44c14b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=91ff70ae363b4f6cabed63522d2304e6, user_id=3835f7fe43454f74b676df5a9eb7b7f3, role_id=438e6120d45e41cb9ae73ac4bdd1750d)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:18.516813 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a2b5e-45b9-4534-b16c-6c13b44c14b9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:18.536473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 119/234] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:18 2022] PUT /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/3835f7fe43454f74b676df5a9eb7b7f3/roles/438e6120d45e41cb9ae73ac4bdd1750d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:19.615325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f456-d5d1-4495-a840-01c0135845f9 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:19.615844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f456-d5d1-4495-a840-01c0135845f9 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:19.615844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f456-d5d1-4495-a840-01c0135845f9 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:19.617368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 116/235] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:09:19.623318 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43ccda-c7b9-45d9-843d-8e849631aba2 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:19.623784 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43ccda-c7b9-45d9-843d-8e849631aba2 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:19.623861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43ccda-c7b9-45d9-843d-8e849631aba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:19.625448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04466d-c80c-4046-81c7-ded0488550a8 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:19.625762 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04466d-c80c-4046-81c7-ded0488550a8 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:19.626034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04466d-c80c-4046-81c7-ded0488550a8 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:19.627474 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 117/236] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:09:19.632613 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e60d3-affc-4f98-85b8-f3782a3d81a0 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:19.632894 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e60d3-affc-4f98-85b8-f3782a3d81a0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:19.633178 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e60d3-affc-4f98-85b8-f3782a3d81a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:19.637311 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:19.653392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-8d1e60d3-affc-4f98-85b8-f3782a3d81a0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:19.654815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-8d1e60d3-affc-4f98-85b8-f3782a3d81a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:19.655463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-0b43ccda-c7b9-45d9-843d-8e849631aba2 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:19.656638 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-0b43ccda-c7b9-45d9-843d-8e849631aba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:19.727718 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 118/237] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:19.770739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e60d3-affc-4f98-85b8-f3782a3d81a0 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:19.789709 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 120/238] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:19.815477 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43ccda-c7b9-45d9-843d-8e849631aba2 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:19.849896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:19.967601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e60d3-affc-4f98-85b8-f3782a3d81a0 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:20.023763 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43ccda-c7b9-45d9-843d-8e849631aba2 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:20.024630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:20.025453 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.025947 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.026667 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.044373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:20.050911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:20.051829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:20.052646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 119/239] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:20.059649 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:20.103285 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:20.103953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.104759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.105043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.110815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:20.112281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:20.118387 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 121/240] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:20.120812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:20.125952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:20.242727 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d8ee-5ddc-4afd-91df-9908f69555cc None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:20.246089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:20.295571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:20.296212 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.296495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.296772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.297493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] RBAC: Adding query filter params (name=reader) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:20.297822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:20.299211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:20.320303 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 120/241] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:20.326380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:20.351445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd8bf-0b08-48a3-9e84-c5be33307964 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:20.405627 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:20.406619 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.407092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.407556 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.409324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:20.416042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:20.453971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 122/242] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:20 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:20.506404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac73d-f1a9-43b7-aee4-2f724d2a14df None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:20.551783 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d5a3a-631f-42ae-9647-811f07ccdf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:20.552834 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5a3a-631f-42ae-9647-811f07ccdf15 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.553333 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5a3a-631f-42ae-9647-811f07ccdf15 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.553822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5a3a-631f-42ae-9647-811f07ccdf15 None admin] PATH_INFO: `/v3/users/edc482cab1314814bf19d6c7b770d781` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.574541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d5a3a-631f-42ae-9647-811f07ccdf15 None admin] RBAC: Authorizing `identity:get_user(user_id=edc482cab1314814bf19d6c7b770d781)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:20.576405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d5a3a-631f-42ae-9647-811f07ccdf15 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:20.578785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 121/243] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:20 2022] GET /identity/v3/users/edc482cab1314814bf19d6c7b770d781 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:20.584563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:20.669741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:20.740226 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc42a6-a00a-4d21-9404-02f91e96b486 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:20.768016 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a2c48-4d61-444e-b918-5c7014f9011e None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.768505 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a2c48-4d61-444e-b918-5c7014f9011e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.768505 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a2c48-4d61-444e-b918-5c7014f9011e None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.770032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 122/244] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:20.781949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fad19-3beb-4c3d-821a-5d08f5754735 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.782252 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fad19-3beb-4c3d-821a-5d08f5754735 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.782498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fad19-3beb-4c3d-821a-5d08f5754735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.813995 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:20.815063 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:20.815547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:20.816097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:20.817439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-796fad19-3beb-4c3d-821a-5d08f5754735 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:20.820926 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-796fad19-3beb-4c3d-821a-5d08f5754735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:20.862015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:20.926450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:20.928132 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:20.928608 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 123/245] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:20.985889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fad19-3beb-4c3d-821a-5d08f5754735 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.010044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:21.075642 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 123/246] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:21.082813 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.141313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fad19-3beb-4c3d-821a-5d08f5754735 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:21.197764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:21.199539 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.200024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.200494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.218431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:21.224118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:21.225074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:21.225906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:21.226513 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203085-3983-43ff-a90c-3a6ad06e4b5b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:21.228912 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 124/247] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:21.235464 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.258864 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:21.277107 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe813b-fb69-453a-b6a5-a6e348536b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:21.277773 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe813b-fb69-453a-b6a5-a6e348536b70 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.278058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe813b-fb69-453a-b6a5-a6e348536b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.278381 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe813b-fb69-453a-b6a5-a6e348536b70 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.279603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe813b-fb69-453a-b6a5-a6e348536b70 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:21.281047 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe813b-fb69-453a-b6a5-a6e348536b70 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:21.283154 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 124/248] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:21.285056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff89a9e-0d72-482a-9e33-0b7575864e85 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.285056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff89a9e-0d72-482a-9e33-0b7575864e85 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.285056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff89a9e-0d72-482a-9e33-0b7575864e85 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.286408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 125/249] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:21.291740 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcc50-8a1b-482b-be64-3237e9d2a160 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.292557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcc50-8a1b-482b-be64-3237e9d2a160 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.292837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcc50-8a1b-482b-be64-3237e9d2a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.315117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-b0bdcc50-8a1b-482b-be64-3237e9d2a160 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:21.316615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-b0bdcc50-8a1b-482b-be64-3237e9d2a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:21.346216 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:21.374910 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00929d1-50bc-4241-9e8e-95d31c668b0a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:21.399302 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 126/250] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:21.401715 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcc50-8a1b-482b-be64-3237e9d2a160 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.419491 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100616b-9bc6-42a4-b513-17bc6ca94b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:21.420524 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100616b-9bc6-42a4-b513-17bc6ca94b17 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.420838 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100616b-9bc6-42a4-b513-17bc6ca94b17 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.421118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100616b-9bc6-42a4-b513-17bc6ca94b17 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.422104 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100616b-9bc6-42a4-b513-17bc6ca94b17 None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:21.422418 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100616b-9bc6-42a4-b513-17bc6ca94b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:21.425410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100616b-9bc6-42a4-b513-17bc6ca94b17 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:21.437062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 125/251] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:21.438223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3e7b-a7b5-4848-ba69-70fc7177a14c None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.438515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3e7b-a7b5-4848-ba69-70fc7177a14c None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.438879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3e7b-a7b5-4848-ba69-70fc7177a14c None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.440875 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 126/252] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:21.441938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3e7b-a7b5-4848-ba69-70fc7177a14c None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.539197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcc50-8a1b-482b-be64-3237e9d2a160 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:21.546032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:21.561506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3e7b-a7b5-4848-ba69-70fc7177a14c None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:21.577371 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac40af2-7895-4209-8856-3cb1a9f1cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:21.578077 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac40af2-7895-4209-8856-3cb1a9f1cfd5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.578414 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac40af2-7895-4209-8856-3cb1a9f1cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.578728 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac40af2-7895-4209-8856-3cb1a9f1cfd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.579539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac40af2-7895-4209-8856-3cb1a9f1cfd5 None admin] RBAC: Adding query filter params (role.id=9ad57f42e0174b04948f81a6e5d2b496, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=edc482cab1314814bf19d6c7b770d781) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:21.579839 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac40af2-7895-4209-8856-3cb1a9f1cfd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:21.581301 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac40af2-7895-4209-8856-3cb1a9f1cfd5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:21.587385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 127/253] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/role_assignments?user.id=edc482cab1314814bf19d6c7b770d781&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=9ad57f42e0174b04948f81a6e5d2b496 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:21.589280 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa651-eedf-45b7-8b79-16863c4527bb None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.589520 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa651-eedf-45b7-8b79-16863c4527bb None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.589793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa651-eedf-45b7-8b79-16863c4527bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.608766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-a25aa651-eedf-45b7-8b79-16863c4527bb None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:21.609921 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-a25aa651-eedf-45b7-8b79-16863c4527bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:21.614600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:21.615647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.616157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.616636 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:21.631036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:21.638796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:21.639768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:21.640554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:21.643307 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 127/254] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:21.650047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.690594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 128/255] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:21.691644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa651-eedf-45b7-8b79-16863c4527bb None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.772538 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd35c92-e7da-45c6-bcfc-1d122b7269ca None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:21.808505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa651-eedf-45b7-8b79-16863c4527bb None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:21.814682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:21.815358 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.815646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.815927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] PATH_INFO: `/v3/users/f586c41d7cb742a7a1c49d54bf135846` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.817179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] RBAC: Authorizing `identity:get_user(user_id=f586c41d7cb742a7a1c49d54bf135846)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:21.818855 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:21.820569 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 128/256] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/users/f586c41d7cb742a7a1c49d54bf135846 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:21.821675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.825402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:21.851738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:21.852766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:21.853250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:21.853764 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:21.854980 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:21.855505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:21.857108 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:21.867651 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 129/257] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:21.869192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:21.899977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:21.988144 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3eef7-c4d1-4d1a-aa69-bed5a894dd3c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:22.030292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:22.031756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:22.032240 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:22.032709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:22.046184 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:22.053295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:22.054211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:22.055006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:22.058584 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 129/258] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:22.059769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:22.078323 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6384e9-a1a0-4ab3-b67d-7c374f8b1df4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:22.148140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:22.148850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:22.149133 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:22.149407 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:22.150626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:22.152617 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:22.154365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 130/259] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:21 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:22.155199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:22.206824 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:22.248431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1df90-73d3-42b6-af07-3bd25b049812 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:22.286345 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:22.287503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:22.287784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:22.288061 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] PATH_INFO: `/v3/users/3835f7fe43454f74b676df5a9eb7b7f3` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:22.289328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] RBAC: Authorizing `identity:get_user(user_id=3835f7fe43454f74b676df5a9eb7b7f3)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:22.291334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:22.293966 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 130/260] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:22 2022] GET /identity/v3/users/3835f7fe43454f74b676df5a9eb7b7f3 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:22.295216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:22.342288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:22.355845 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece00c-46f2-49fa-bba6-5bd4a385c919 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:22.422632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:22.423124 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74f6ca-351f-45d5-962e-dccff130e753 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:22.423821 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:22.424317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:22.424799 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:22.425741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:22.426245 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:22.427827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:22.444758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 131/261] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:22.445738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:22.455626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:22.498376 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:22.499081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:22.499369 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:22.499648 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/f586c41d7cb742a7a1c49d54bf135846/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:22.511018 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=91ff70ae363b4f6cabed63522d2304e6, user_id=f586c41d7cb742a7a1c49d54bf135846, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:22.512951 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:22.556796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 131/262] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:22 2022] PUT /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/f586c41d7cb742a7a1c49d54bf135846/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:22.557964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:22.584647 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2d931-6d36-4011-9c64-790e5a483009 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:22.627793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:22.629219 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:22.629806 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:22.630284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:22.647543 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:22.749499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:22.751618 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:22.904027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 132/263] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:22.910285 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:22.913970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33787f46-e8d2-4ba1-a080-b139f89bffa1 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:22.981171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:22.984553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:22.985065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:22.985281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:22.985801 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] PATH_INFO: `/v3/users/3835f7fe43454f74b676df5a9eb7b7f3` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:22.987303 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] RBAC: Authorizing `identity:get_user(user_id=3835f7fe43454f74b676df5a9eb7b7f3)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:22.989126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:22.991399 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 132/264] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:22 2022] GET /identity/v3/users/3835f7fe43454f74b676df5a9eb7b7f3 => generated 283 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:22.998844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:23.087163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33e49-9856-4272-ab26-a8b842d5be0e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:23.111434 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:23.170635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:23.171315 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:23.171590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:23.171860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:23.174082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:23.175711 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:23.177442 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 133/265] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:22 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:23.184563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:23.205814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0732875-52b1-4fd7-aff3-102f8eecc86f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:23.303378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:23.303927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:23.304207 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:23.304478 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:23.363290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b55ac2-90c5-42d7-97fa-e9dd7ebe139f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:23.398018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:23.411620 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:23.412252 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:23.412526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:23.412793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:23.413587 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=3835f7fe43454f74b676df5a9eb7b7f3) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:23.413923 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:23.415377 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:23.433958 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 134/266] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:23 2022] GET /identity/v3/role_assignments?user.id=3835f7fe43454f74b676df5a9eb7b7f3&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=40fb60241dc645059f308de1b41e6e44 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:23.445102 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:23.446969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:23.517970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:23.571370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 133/267] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:23.578220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:23.742900 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c486b-b98c-4cf4-99b2-38677a10c145 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:23.796149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d95a8-4d73-4fc9-953b-0ce3925e0f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:23.796913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d95a8-4d73-4fc9-953b-0ce3925e0f91 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:23.797092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d95a8-4d73-4fc9-953b-0ce3925e0f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:23.797354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d95a8-4d73-4fc9-953b-0ce3925e0f91 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:23.802661 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d95a8-4d73-4fc9-953b-0ce3925e0f91 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:23.804171 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d95a8-4d73-4fc9-953b-0ce3925e0f91 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:23.806057 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 135/268] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:23 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:23.814884 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:23.990306 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d58b1-6eba-409f-88d2-a31027b77767 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:24.035676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c5745-23d5-4833-b610-481cb9558116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:24.036319 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c5745-23d5-4833-b610-481cb9558116 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.036602 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c5745-23d5-4833-b610-481cb9558116 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.036874 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c5745-23d5-4833-b610-481cb9558116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.037677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c5745-23d5-4833-b610-481cb9558116 None admin] RBAC: Adding query filter params (role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=3835f7fe43454f74b676df5a9eb7b7f3) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:24.037997 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c5745-23d5-4833-b610-481cb9558116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:24.039429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c5745-23d5-4833-b610-481cb9558116 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:24.047255 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 134/269] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:23 2022] GET /identity/v3/role_assignments?user.id=3835f7fe43454f74b676df5a9eb7b7f3&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:24.159589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c42a-b3d5-4934-8b39-f4a958d19a6f None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.160214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c42a-b3d5-4934-8b39-f4a958d19a6f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.160719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c42a-b3d5-4934-8b39-f4a958d19a6f None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.162365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 136/270] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:24.170205 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7990e6-5b68-456c-ba6a-1fa94fabfcfb None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.170489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7990e6-5b68-456c-ba6a-1fa94fabfcfb None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.171002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7990e6-5b68-456c-ba6a-1fa94fabfcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.194781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-ae7990e6-5b68-456c-ba6a-1fa94fabfcfb None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:24.196374 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-ae7990e6-5b68-456c-ba6a-1fa94fabfcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:24.221087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:24.271021 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11ccc8-bacf-42ba-bd17-7a59abbdcc5f None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.271191 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11ccc8-bacf-42ba-bd17-7a59abbdcc5f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.271464 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11ccc8-bacf-42ba-bd17-7a59abbdcc5f None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.273011 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 137/271] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:09:24.278829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f3f07-c62a-4c69-973f-9e5d31a1a2ab None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.279363 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f3f07-c62a-4c69-973f-9e5d31a1a2ab None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.279812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f3f07-c62a-4c69-973f-9e5d31a1a2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.289982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 135/272] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:24.317825 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7990e6-5b68-456c-ba6a-1fa94fabfcfb None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:24.435256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-bc7f3f07-c62a-4c69-973f-9e5d31a1a2ab None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:24.436811 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-bc7f3f07-c62a-4c69-973f-9e5d31a1a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:24.450926 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7990e6-5b68-456c-ba6a-1fa94fabfcfb None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:24.495783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:24.496120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:24.496943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.497413 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.497905 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.510212 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:24.518169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:24.519106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:24.519901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:24.522552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 136/273] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:24.527678 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 138/274] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:24.529705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:24.547762 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:24.557905 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f3f07-c62a-4c69-973f-9e5d31a1a2ab None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:24.646691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd627cab-5042-4210-9972-a5a5233715f5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:24.663989 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f3f07-c62a-4c69-973f-9e5d31a1a2ab None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:24.690895 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:24.692063 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.692642 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.693126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.694117 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:24.694642 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:24.696452 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:24.707906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 137/275] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:24.713194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:24.719182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:24.720013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.720390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.720760 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.722212 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:24.723909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:24.736966 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 139/276] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:24.747341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:24.803399 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:24.829541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:24.866228 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6c353-4b2c-4c47-a025-63b747c5520e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:24.875297 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a6516-2c5b-4783-bb13-61abfb99d4d5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:24.914417 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:24.915173 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.915463 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.915740 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] PATH_INFO: `/v3/users/66d1dd9a19434f83ac25e7f98ceed1db` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.917085 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30b037-3e56-4f8e-9aef-a0e0da5d2a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:24.918244 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b037-3e56-4f8e-9aef-a0e0da5d2a3c None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:24.918821 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b037-3e56-4f8e-9aef-a0e0da5d2a3c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:24.919295 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b037-3e56-4f8e-9aef-a0e0da5d2a3c None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:24.920183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30b037-3e56-4f8e-9aef-a0e0da5d2a3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:24.921850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30b037-3e56-4f8e-9aef-a0e0da5d2a3c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:24.930822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] RBAC: Authorizing `identity:get_user(user_id=66d1dd9a19434f83ac25e7f98ceed1db)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:24.936358 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:24.939332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 138/277] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:24 2022] GET /identity/v3/users/66d1dd9a19434f83ac25e7f98ceed1db => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:24.945887 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:24.957690 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 140/278] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:24 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:09:25.089624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9225-b2d9-4407-bc2d-53a22d803489 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:25.124686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b523e-6435-4b58-aae6-f90e05d39650 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.125025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b523e-6435-4b58-aae6-f90e05d39650 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.125254 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b523e-6435-4b58-aae6-f90e05d39650 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.127087 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 141/279] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:09:25.130038 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:25.131946 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:25.132606 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.132833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c6a5-6634-410e-bfd8-ad4299ddc47d None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.132938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.133124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c6a5-6634-410e-bfd8-ad4299ddc47d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.133236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.133453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c6a5-6634-410e-bfd8-ad4299ddc47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.134104 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, user.id=66d1dd9a19434f83ac25e7f98ceed1db, scope.system=all) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:25.134425 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:25.136582 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:25.143106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 139/280] 10.222.0.71 () {56 vars in 1308 bytes} [Wed Jul 27 19:09:24 2022] GET /identity/v3/role_assignments?user.id=66d1dd9a19434f83ac25e7f98ceed1db&scope.system=all&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:25.158697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-36c8c6a5-6634-410e-bfd8-ad4299ddc47d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:25.159989 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-36c8c6a5-6634-410e-bfd8-ad4299ddc47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:25.249527 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 142/281] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:25.276590 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:25.409806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64ab2-bcbb-427c-be1b-cee235f38271 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:25.451481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb0b6c-f397-4cb1-a970-ff6051088a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:25.452140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0b6c-f397-4cb1-a970-ff6051088a7d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.452489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0b6c-f397-4cb1-a970-ff6051088a7d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.452767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0b6c-f397-4cb1-a970-ff6051088a7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.464805 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb0b6c-f397-4cb1-a970-ff6051088a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-adcb0b6c-f397-4cb1-a970-ff6051088a7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:25.470129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:25.471035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:25.471965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 140/282] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:25.477357 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8c6a5-6634-410e-bfd8-ad4299ddc47d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:25.509881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:25.557752 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126415c-1374-4875-8e4d-c5a3f643312d None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.558807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126415c-1374-4875-8e4d-c5a3f643312d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.559194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126415c-1374-4875-8e4d-c5a3f643312d None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.563428 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 141/283] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:25.567763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645f8a-9ff1-44ad-a60d-95d1ec001948 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.568178 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645f8a-9ff1-44ad-a60d-95d1ec001948 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.568559 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645f8a-9ff1-44ad-a60d-95d1ec001948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.609418 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-7b645f8a-9ff1-44ad-a60d-95d1ec001948 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:25.610699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-7b645f8a-9ff1-44ad-a60d-95d1ec001948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:25.622270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8c6a5-6634-410e-bfd8-ad4299ddc47d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:25.699405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:25.705685 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:25.706411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.706696 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.706970 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.707694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:25.708003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:25.710756 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:25.730476 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 143/284] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:25.734491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:25.747803 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 142/285] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:25.789999 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b645f8a-9ff1-44ad-a60d-95d1ec001948 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:25.858066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:25.877598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84227a8-798c-4a35-a58c-499c19964a39 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:25.918920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:25.919585 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.919866 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.920139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] PATH_INFO: `/v3/users/edc482cab1314814bf19d6c7b770d781` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.921344 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] RBAC: Authorizing `identity:get_user(user_id=edc482cab1314814bf19d6c7b770d781)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:25.923304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:25.925333 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 144/286] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:25 2022] GET /identity/v3/users/edc482cab1314814bf19d6c7b770d781 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:25.931520 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:25.978810 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b645f8a-9ff1-44ad-a60d-95d1ec001948 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:26.017831 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:26.018494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:26.018784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:26.019065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:26.030595 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:26.036227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:26.037328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:26.038364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 143/287] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:26.050815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:26.138154 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:26.200568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d56c3-abb4-450e-a3d5-ce0b400647d6 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:26.238901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:26.239560 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:26.239911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:26.240263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:26.241301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:26.241701 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:26.244502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:26.252667 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6062e9-2a9d-4961-91a4-1fc8a2892937 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:26.257939 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 144/288] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:26.265195 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:26.337337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:26.338026 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:26.338343 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:26.338626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:26.342393 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:26.344313 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:26.350766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 145/289] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:25 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:26.356746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:26.384551 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88379899-010f-4a2d-8df9-82d4a1205c03 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:26.396607 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:26.418018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:26.427967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:26.428907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:26.429197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:26.429479 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] PATH_INFO: `/v3/users/f586c41d7cb742a7a1c49d54bf135846` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:26.430863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] RBAC: Authorizing `identity:get_user(user_id=f586c41d7cb742a7a1c49d54bf135846)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:26.433937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:26.435715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 145/290] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:26 2022] GET /identity/v3/users/f586c41d7cb742a7a1c49d54bf135846 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:26.441873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:26.561758 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec05e6-4ec9-46ac-888e-c4fd5faaa59f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:26.573574 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795406-8ae7-4c1f-9e3a-546741fa1bb2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:26.596302 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:26.596540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:26.596765 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:26.599082 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:26.652236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:26.652951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:26.653233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:26.653511 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/edc482cab1314814bf19d6c7b770d781/roles/9ad57f42e0174b04948f81a6e5d2b496` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:26.659005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] RBAC: Authorizing `identity:create_grant(project_id=91ff70ae363b4f6cabed63522d2304e6, user_id=edc482cab1314814bf19d6c7b770d781, role_id=9ad57f42e0174b04948f81a6e5d2b496)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:26.662713 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:26.691319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 146/291] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:09:26 2022] PUT /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6/users/edc482cab1314814bf19d6c7b770d781/roles/9ad57f42e0174b04948f81a6e5d2b496 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:09:26.707724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:26.726764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:26.728531 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:26.897524 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 146/292] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 19:09:26.904251 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:27.003126 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:27.026329 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21d89-159f-474c-a8d3-e3dc4a2e5299 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:27.069574 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278d2bc-4d86-45f5-b6ed-d579539ad7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:27.070356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278d2bc-4d86-45f5-b6ed-d579539ad7c1 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:27.070646 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278d2bc-4d86-45f5-b6ed-d579539ad7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:27.070926 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278d2bc-4d86-45f5-b6ed-d579539ad7c1 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:27.075023 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278d2bc-4d86-45f5-b6ed-d579539ad7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:27.076474 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278d2bc-4d86-45f5-b6ed-d579539ad7c1 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:27.078209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 147/293] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:26 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:27.083982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:27.205302 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:27.234371 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0cba-9586-4489-b695-c01f30ad886d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:27.295529 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95704a-6ce3-406c-9397-9fe10f499337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:27.296177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95704a-6ce3-406c-9397-9fe10f499337 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:27.296459 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95704a-6ce3-406c-9397-9fe10f499337 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:27.296739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95704a-6ce3-406c-9397-9fe10f499337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:27.297541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95704a-6ce3-406c-9397-9fe10f499337 None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=f586c41d7cb742a7a1c49d54bf135846) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:27.297875 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95704a-6ce3-406c-9397-9fe10f499337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:27.299323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95704a-6ce3-406c-9397-9fe10f499337 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:27.311783 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 147/294] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:27 2022] GET /identity/v3/role_assignments?user.id=f586c41d7cb742a7a1c49d54bf135846&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:27.976820 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23352d11-68a8-4861-99f0-d489cfcb84b9 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:27.977812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23352d11-68a8-4861-99f0-d489cfcb84b9 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:27.978286 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23352d11-68a8-4861-99f0-d489cfcb84b9 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:27.980930 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 148/295] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:27.986389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85850043-714c-443c-bca7-a9ef5b79bb93 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:27.986675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85850043-714c-443c-bca7-a9ef5b79bb93 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:27.986951 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85850043-714c-443c-bca7-a9ef5b79bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.006537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-85850043-714c-443c-bca7-a9ef5b79bb93 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:28.007652 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-85850043-714c-443c-bca7-a9ef5b79bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:28.087696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 148/296] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:28.097732 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286566b-7ac7-4b92-8ae5-c2627d9e696d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.098039 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286566b-7ac7-4b92-8ae5-c2627d9e696d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.098308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286566b-7ac7-4b92-8ae5-c2627d9e696d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.100177 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 149/297] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:28.106343 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26864d26-487e-4b1e-befb-056935bf9ec9 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.106655 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26864d26-487e-4b1e-befb-056935bf9ec9 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.106940 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26864d26-487e-4b1e-befb-056935bf9ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.113947 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844f81-8d33-4161-9390-b3bf5a3f72bc None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.114247 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844f81-8d33-4161-9390-b3bf5a3f72bc None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.114519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844f81-8d33-4161-9390-b3bf5a3f72bc None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.116118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 150/298] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:28.116844 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45844f81-8d33-4161-9390-b3bf5a3f72bc None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.130226 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-26864d26-487e-4b1e-befb-056935bf9ec9 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:28.131659 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-26864d26-487e-4b1e-befb-056935bf9ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:28.214834 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:28.221843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 149/299] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:28.231542 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb97fe-eae3-4bc0-a504-9d895e78c4d3 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.232199 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb97fe-eae3-4bc0-a504-9d895e78c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.232695 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb97fe-eae3-4bc0-a504-9d895e78c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.248532 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45844f81-8d33-4161-9390-b3bf5a3f72bc None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:28.253631 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-37fb97fe-eae3-4bc0-a504-9d895e78c4d3 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:28.255112 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-37fb97fe-eae3-4bc0-a504-9d895e78c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:28.298281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:28.299217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.299656 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.300105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.317502 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:28.326553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:28.328614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:28.330850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 151/300] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:28.335834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.352234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 150/301] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:28.353076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:28.356351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb97fe-eae3-4bc0-a504-9d895e78c4d3 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.467060 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989d39-930a-4c18-90bd-1d317ed87615 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:28.473961 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb97fe-eae3-4bc0-a504-9d895e78c4d3 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:28.504515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:28.505733 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:28.506620 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.507100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.507522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.512124 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:28.512757 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.513120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.513359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.514144 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:28.514450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:28.515832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:28.520262 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:28.529943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 151/302] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:28.529943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:28.530209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:28.531201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:28.532180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 152/303] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:28.534146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.618483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:28.648063 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e400-0c32-4a08-a90a-6ccb2626b799 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:28.654276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea8185-c02d-4a5f-b945-c43bd339cd9e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:28.694116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:28.694786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.695070 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.695345 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.696646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:28.696836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:28.698401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.698675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.698808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:28.699042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.699645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:28.699944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:28.705448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 152/304] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:28.705448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.705719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:28.718500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 153/305] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:28.718500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.778986 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:28.834527 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66774f4f-c5b4-47df-a569-8af6007b83ad None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:28.837421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42820bc-148e-4f74-a47e-3d11451607fb None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:28.875192 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:28.875785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.876066 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.876342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] PATH_INFO: `/v3/users/66d1dd9a19434f83ac25e7f98ceed1db` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.877217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:28.877508 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] RBAC: Authorizing `identity:get_user(user_id=66d1dd9a19434f83ac25e7f98ceed1db)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:28.877877 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:28.878161 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:28.878505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] PATH_INFO: `/v3/groups` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:28.878992 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:28.879089 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:28.885998 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:28.886179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 153/306] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:28 2022] GET /identity/v3/users/66d1dd9a19434f83ac25e7f98ceed1db => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:28.886179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:28.888485 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:28.917919 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 154/307] 10.222.0.71 () {60 vars in 1134 bytes} [Wed Jul 27 19:09:28 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:28.917919 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:29.031583 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9445ec-7e90-45fc-960d-e5f1513e6416 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:29.044113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62ad3-af99-4c8f-a807-6edbad36dba5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:29.075649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:29.076544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.076898 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.077286 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] PATH_INFO: `/v3/system/users/66d1dd9a19434f83ac25e7f98ceed1db/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.080475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66d1dd9a19434f83ac25e7f98ceed1db, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:29.082484 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:29.087536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:29.105682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 155/308] 10.222.0.71 () {58 vars in 1334 bytes} [Wed Jul 27 19:09:28 2022] PUT /identity/v3/system/users/66d1dd9a19434f83ac25e7f98ceed1db/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:29.108029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ce5b9-45c9-408f-8b01-fb1e850adcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:29.108784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce5b9-45c9-408f-8b01-fb1e850adcbf None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.109075 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce5b9-45c9-408f-8b01-fb1e850adcbf None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.109356 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce5b9-45c9-408f-8b01-fb1e850adcbf None admin] PATH_INFO: `/v3/users/d172e507d84a4212836d741f293c0122` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.130225 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce5b9-45c9-408f-8b01-fb1e850adcbf None admin] RBAC: Authorizing `identity:get_user(user_id=d172e507d84a4212836d741f293c0122)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:29.131842 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce5b9-45c9-408f-8b01-fb1e850adcbf None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:29.134309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 154/309] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:28 2022] GET /identity/v3/users/d172e507d84a4212836d741f293c0122 => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:29.141452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:29.223632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:29.281615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b40a30-dd6b-41e6-a2df-fbacd96adb4d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:29.301614 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830b3d-9c66-4965-b470-10ab6b5138d8 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.302197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830b3d-9c66-4965-b470-10ab6b5138d8 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.302197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830b3d-9c66-4965-b470-10ab6b5138d8 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.303909 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 155/310] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:29.311465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd79b2c-b69b-44fa-808a-2c31faf96ef1 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.311885 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd79b2c-b69b-44fa-808a-2c31faf96ef1 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.312165 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd79b2c-b69b-44fa-808a-2c31faf96ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.332155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:29.332793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.333078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.333354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.334212 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] RBAC: Adding query filter params (role.id=9ad57f42e0174b04948f81a6e5d2b496, user.id=d172e507d84a4212836d741f293c0122, scope.system=all) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:29.334522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:29.335969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:29.340628 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-6bd79b2c-b69b-44fa-808a-2c31faf96ef1 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:29.342725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-6bd79b2c-b69b-44fa-808a-2c31faf96ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:29.349688 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 156/311] 10.222.0.71 () {56 vars in 1308 bytes} [Wed Jul 27 19:09:29 2022] GET /identity/v3/role_assignments?user.id=d172e507d84a4212836d741f293c0122&scope.system=all&role.id=9ad57f42e0174b04948f81a6e5d2b496 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:29.426494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 156/312] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:29.450602 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:29.567667 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e18c1-4976-41d1-bbe3-a950987ab1a8 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:29.593679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:29.607593 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:29.608535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.608967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.609393 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.621677 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:29.627423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:29.628549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:29.629566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:29.632186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 157/313] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:29.638826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd79b2c-b69b-44fa-808a-2c31faf96ef1 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:29.752315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd79b2c-b69b-44fa-808a-2c31faf96ef1 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:29.778159 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:29.790567 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:29.791846 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.792220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.792580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.793600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:29.793987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:29.795399 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:29.805005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 157/314] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:29.811738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:29.941577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40823ecf-588b-433b-a859-31f8ec4c0148 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:29.979331 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:29.979990 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:29.980270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:29.980543 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] PATH_INFO: `/v3/users/edc482cab1314814bf19d6c7b770d781` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:29.981767 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] RBAC: Authorizing `identity:get_user(user_id=edc482cab1314814bf19d6c7b770d781)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:29.983214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:29.985005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 158/315] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:29 2022] GET /identity/v3/users/edc482cab1314814bf19d6c7b770d781 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:29.990553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:30.100741 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745de25b-c752-4ce0-86de-9c029a4080c4 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:30.137664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:30.138299 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:30.138578 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:30.138852 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:30.191809 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:30.213998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:30.215616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:30.328117 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 158/316] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:30.333507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:30.388137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:30.445253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba4d0-59d8-48f6-9e48-cc088953639b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:30.483553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8592f8-b2d3-4cc9-b0a3-40df2d3272cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:30.484199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8592f8-b2d3-4cc9-b0a3-40df2d3272cf None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:30.484477 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8592f8-b2d3-4cc9-b0a3-40df2d3272cf None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:30.484748 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8592f8-b2d3-4cc9-b0a3-40df2d3272cf None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:30.486031 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8592f8-b2d3-4cc9-b0a3-40df2d3272cf None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:30.487459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8592f8-b2d3-4cc9-b0a3-40df2d3272cf None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:30.489635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 159/317] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:30 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:30.496118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:30.580786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:30.604188 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e278ae-1e21-4e97-9bb2-70cae4b8a984 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:30.640318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b70bbb-3c44-4ed4-9cef-2f814db80d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:30.640958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70bbb-3c44-4ed4-9cef-2f814db80d85 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:30.641240 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70bbb-3c44-4ed4-9cef-2f814db80d85 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:30.641514 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70bbb-3c44-4ed4-9cef-2f814db80d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:30.642353 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b70bbb-3c44-4ed4-9cef-2f814db80d85 None admin] RBAC: Adding query filter params (role.id=9ad57f42e0174b04948f81a6e5d2b496, scope.project.id=91ff70ae363b4f6cabed63522d2304e6, user.id=edc482cab1314814bf19d6c7b770d781) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:30.642665 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b70bbb-3c44-4ed4-9cef-2f814db80d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:30.644122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b70bbb-3c44-4ed4-9cef-2f814db80d85 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:30.652045 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 159/318] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:30 2022] GET /identity/v3/role_assignments?user.id=edc482cab1314814bf19d6c7b770d781&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=9ad57f42e0174b04948f81a6e5d2b496 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:31.428566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91b98-1fda-4d25-b0d2-4f75c3ab73fc None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.429144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91b98-1fda-4d25-b0d2-4f75c3ab73fc None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.429144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91b98-1fda-4d25-b0d2-4f75c3ab73fc None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.430631 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 160/319] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:31.437137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04350fa0-6a0e-4367-a30b-a633e8769699 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.437717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04350fa0-6a0e-4367-a30b-a633e8769699 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.437796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04350fa0-6a0e-4367-a30b-a633e8769699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.457183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-04350fa0-6a0e-4367-a30b-a633e8769699 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:31.458405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-04350fa0-6a0e-4367-a30b-a633e8769699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:31.531998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 160/320] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:31.549245 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c857a5-6283-4304-8ac2-bfbb8b59141c None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.549599 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c857a5-6283-4304-8ac2-bfbb8b59141c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.549838 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c857a5-6283-4304-8ac2-bfbb8b59141c None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.551343 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 161/321] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:31.555267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04350fa0-6a0e-4367-a30b-a633e8769699 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:31.556458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba247a-cdf6-40b8-9ab8-7d48224163ef None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.557253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba247a-cdf6-40b8-9ab8-7d48224163ef None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.557769 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba247a-cdf6-40b8-9ab8-7d48224163ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.577817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-e0ba247a-cdf6-40b8-9ab8-7d48224163ef None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:31.579009 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-e0ba247a-cdf6-40b8-9ab8-7d48224163ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:31.637421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:31.659858 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 162/322] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:31.675370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04350fa0-6a0e-4367-a30b-a633e8769699 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:31.684955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba247a-cdf6-40b8-9ab8-7d48224163ef None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:31.717268 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:31.717944 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.718223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.718499 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.719669 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:31.721132 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:31.723081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 161/323] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:31.728683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:31.748548 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:31.804612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba247a-cdf6-40b8-9ab8-7d48224163ef None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:31.842365 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ac7b3-be10-4fae-8b90-e05729e0cb08 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:31.843280 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae658f-9dfc-49e8-9c69-c3f740441531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:31.843922 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae658f-9dfc-49e8-9c69-c3f740441531 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.844198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae658f-9dfc-49e8-9c69-c3f740441531 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.844469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae658f-9dfc-49e8-9c69-c3f740441531 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.855290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae658f-9dfc-49e8-9c69-c3f740441531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-2bae658f-9dfc-49e8-9c69-c3f740441531 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:31.860185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:31.861105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:31.861943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 163/324] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:31.863746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27804-4a49-4315-a997-398d5f6a4e5d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.864036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27804-4a49-4315-a997-398d5f6a4e5d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.864428 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27804-4a49-4315-a997-398d5f6a4e5d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.866104 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 164/325] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:31.867378 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b27804-4a49-4315-a997-398d5f6a4e5d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:31.880101 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4b04a-10a5-40fe-8d8b-65716ddbfc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:31.880568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4b04a-10a5-40fe-8d8b-65716ddbfc39 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.880850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4b04a-10a5-40fe-8d8b-65716ddbfc39 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.881121 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4b04a-10a5-40fe-8d8b-65716ddbfc39 None admin] PATH_INFO: `/v3/groups` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.881840 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4b04a-10a5-40fe-8d8b-65716ddbfc39 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:31.883326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4b04a-10a5-40fe-8d8b-65716ddbfc39 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:31.901691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:31.907518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 162/326] 10.222.0.71 () {60 vars in 1134 bytes} [Wed Jul 27 19:09:31 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:31.909051 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd0e46-8a7d-4741-9740-0f5edbd6d6a5 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:31.909420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd0e46-8a7d-4741-9740-0f5edbd6d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:31.909722 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd0e46-8a7d-4741-9740-0f5edbd6d6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:31.935357 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-1acd0e46-8a7d-4741-9740-0f5edbd6d6a5 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:31.936502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-1acd0e46-8a7d-4741-9740-0f5edbd6d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:32.011825 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b27804-4a49-4315-a997-398d5f6a4e5d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:32.023100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:32.037404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 163/327] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:32.054656 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:32.055368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:32.055578 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:32.055848 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:32.056580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] RBAC: Adding query filter params (name=member) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:32.057506 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:32.059183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:32.062738 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd0e46-8a7d-4741-9740-0f5edbd6d6a5 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:32.068978 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 165/328] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:32.076233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:32.219831 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd0e46-8a7d-4741-9740-0f5edbd6d6a5 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:32.220955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42291b7b-b26a-4a8c-a07b-bb7e0e9cec81 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:32.263742 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:32.283918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:32.284958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:32.285450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:32.286545 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:32.286688 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:32.287595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:32.287873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:32.288144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] PATH_INFO: `/v3/users/66d1dd9a19434f83ac25e7f98ceed1db` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:32.289364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] RBAC: Authorizing `identity:get_user(user_id=66d1dd9a19434f83ac25e7f98ceed1db)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:32.291314 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:32.293233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 166/329] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:32 2022] GET /identity/v3/users/66d1dd9a19434f83ac25e7f98ceed1db => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:32.301120 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:32.303484 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:32.310266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:32.311512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:32.312301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:32.318109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 164/330] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:32.322961 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:32.385958 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:32.452669 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3dde2-8098-45e6-aea1-618f36688893 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:32.487444 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad096-e49b-4287-8305-4c2bcb48d4b5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:32.511987 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:32.513134 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:32.513613 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:32.514109 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:32.516091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] RBAC: Adding query filter params (role.id=e01dafa93d884a19adb7866841e6ca91, user.id=66d1dd9a19434f83ac25e7f98ceed1db, scope.system=all) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:32.516623 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:32.518234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:32.537743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 167/331] 10.222.0.71 () {56 vars in 1308 bytes} [Wed Jul 27 19:09:32 2022] GET /identity/v3/role_assignments?user.id=66d1dd9a19434f83ac25e7f98ceed1db&scope.system=all&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:32.548261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:32.549294 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:32.549945 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:32.550440 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:32.551446 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:32.551970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:32.553733 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:32.570261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 165/332] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:32.579498 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:32.709515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:32.718218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b36cf-61d4-4706-a9f1-fa98d2b3d47d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:32.781841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3a112-b02f-47fd-9834-ede35e86df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:32.782447 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a112-b02f-47fd-9834-ede35e86df60 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:32.782729 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a112-b02f-47fd-9834-ede35e86df60 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:32.783119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a112-b02f-47fd-9834-ede35e86df60 None admin] PATH_INFO: `/v3/users/d172e507d84a4212836d741f293c0122` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:32.784400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3a112-b02f-47fd-9834-ede35e86df60 None admin] RBAC: Authorizing `identity:get_user(user_id=d172e507d84a4212836d741f293c0122)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:32.785985 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3a112-b02f-47fd-9834-ede35e86df60 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:32.788262 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 168/333] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:32 2022] GET /identity/v3/users/d172e507d84a4212836d741f293c0122 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:32.796215 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:32.884202 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:32.957406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dba276-ebd8-49f7-b783-15ffa95d620e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:33.000663 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca60c0-89b1-483e-9c0a-3dbcea2aaa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:33.001265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca60c0-89b1-483e-9c0a-3dbcea2aaa70 None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:33.001556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca60c0-89b1-483e-9c0a-3dbcea2aaa70 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:33.001896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca60c0-89b1-483e-9c0a-3dbcea2aaa70 None admin] PATH_INFO: `/v3/system/users/d172e507d84a4212836d741f293c0122/roles/9ad57f42e0174b04948f81a6e5d2b496` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:33.005316 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca60c0-89b1-483e-9c0a-3dbcea2aaa70 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d172e507d84a4212836d741f293c0122, role_id=9ad57f42e0174b04948f81a6e5d2b496)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:33.006766 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca60c0-89b1-483e-9c0a-3dbcea2aaa70 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:33.018780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 166/334] 10.222.0.71 () {58 vars in 1334 bytes} [Wed Jul 27 19:09:32 2022] PUT /identity/v3/system/users/d172e507d84a4212836d741f293c0122/roles/9ad57f42e0174b04948f81a6e5d2b496 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:09:34.748120 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3df6-2c40-4a9d-8759-7124f87d5994 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:34.748676 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3df6-2c40-4a9d-8759-7124f87d5994 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:34.748676 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3df6-2c40-4a9d-8759-7124f87d5994 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:34.750458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 169/335] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:34.756387 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa13c6-9ba8-4bce-93af-a456c0823ab1 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:34.756902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa13c6-9ba8-4bce-93af-a456c0823ab1 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:34.757009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa13c6-9ba8-4bce-93af-a456c0823ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:34.779354 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-51fa13c6-9ba8-4bce-93af-a456c0823ab1 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:34.780562 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-51fa13c6-9ba8-4bce-93af-a456c0823ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:34.876330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 167/336] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:34.925575 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3df6-2c40-4a9d-8759-7124f87d5994 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:35.053811 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3df6-2c40-4a9d-8759-7124f87d5994 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:35.094529 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4b165-9c46-44fe-a4ec-61fcde8100c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:35.095193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b165-9c46-44fe-a4ec-61fcde8100c6 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:35.095473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b165-9c46-44fe-a4ec-61fcde8100c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:35.095746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b165-9c46-44fe-a4ec-61fcde8100c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:35.119019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4b165-9c46-44fe-a4ec-61fcde8100c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-36a4b165-9c46-44fe-a4ec-61fcde8100c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:35.125217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:35.126294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:35.127097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 170/337] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:35.135285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa13c6-9ba8-4bce-93af-a456c0823ab1 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:35.197937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:35.276568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa13c6-9ba8-4bce-93af-a456c0823ab1 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:35.316662 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dce6-8faf-4d9c-ad1b-a963732f3e7e None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:35.316849 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dce6-8faf-4d9c-ad1b-a963732f3e7e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:35.317126 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dce6-8faf-4d9c-ad1b-a963732f3e7e None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:35.318562 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 171/338] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:35.325520 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb951-6083-4a1b-87a6-8d1924201e1d None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:35.325841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb951-6083-4a1b-87a6-8d1924201e1d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:35.326116 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb951-6083-4a1b-87a6-8d1924201e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:35.336789 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:35.337753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:35.338139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:35.338421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:35.339227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:35.339534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:35.340943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:35.355253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 168/339] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:35.361692 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:35.366735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-a12cb951-6083-4a1b-87a6-8d1924201e1d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:35.367935 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-a12cb951-6083-4a1b-87a6-8d1924201e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:35.413018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:35.513575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86056-e24e-47c4-84d7-f95ef263ed2f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:35.528710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:35.534609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 172/340] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:35.564225 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cb951-6083-4a1b-87a6-8d1924201e1d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:35.589153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:35.589734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:35.590016 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:35.590286 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:35.710820 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cb951-6083-4a1b-87a6-8d1924201e1d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:35.717847 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:35.719478 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:35.759719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:35.760413 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:35.761137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:35.761561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:35.776342 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:35.781875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:35.782969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:35.783945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:35.787615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 173/341] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:35.802395 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:35.838644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:35.871380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 169/342] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:35.877892 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:35.892242 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:35.999535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043cc58-1fd2-49ed-8910-75279c4c6b5d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:36.005814 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ff3e-48cc-4020-a137-530a63d81bda None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:36.041593 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875efde0-b838-4424-bb65-b1aa94e521ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:36.042860 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875efde0-b838-4424-bb65-b1aa94e521ca None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.043320 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875efde0-b838-4424-bb65-b1aa94e521ca None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.043962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875efde0-b838-4424-bb65-b1aa94e521ca None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.045458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875efde0-b838-4424-bb65-b1aa94e521ca None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:36.047122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875efde0-b838-4424-bb65-b1aa94e521ca None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:36.049365 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 170/343] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:35 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:36.050786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff23bc-58b4-4e9e-b5cf-6a51627a18c4 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.051360 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff23bc-58b4-4e9e-b5cf-6a51627a18c4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.051786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff23bc-58b4-4e9e-b5cf-6a51627a18c4 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.053510 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 171/344] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:36.061068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ffda3-4862-4382-bfbe-324feb75733d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.061719 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ffda3-4862-4382-bfbe-324feb75733d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.062165 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ffda3-4862-4382-bfbe-324feb75733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.062278 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:36.062800 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.063088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.063337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.064055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:36.064352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:36.065741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:36.085326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 174/345] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:36.086441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:36.099113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-7d1ffda3-4862-4382-bfbe-324feb75733d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:36.106435 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-7d1ffda3-4862-4382-bfbe-324feb75733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:36.241945 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 172/346] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:36.243154 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ffda3-4862-4382-bfbe-324feb75733d None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:36.249699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:36.258092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:36.312292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438cf0-d6e5-46b1-a83c-a64c423cd677 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:36.388431 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:36.389164 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.389456 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.389818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.407852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:36.409356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:36.413811 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 175/347] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:36 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:36.416735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:36.455834 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ffda3-4862-4382-bfbe-324feb75733d None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:36.528968 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad2a47-254d-4eda-bc1b-a6a80a7cbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:36.529534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad2a47-254d-4eda-bc1b-a6a80a7cbd85 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.529832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad2a47-254d-4eda-bc1b-a6a80a7cbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.530105 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad2a47-254d-4eda-bc1b-a6a80a7cbd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.623962 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e4c1b-4ed4-46b5-a219-a144b530d35e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:36.640800 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad2a47-254d-4eda-bc1b-a6a80a7cbd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:36.642384 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad2a47-254d-4eda-bc1b-a6a80a7cbd85 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:36.652777 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:36.685271 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:36.686167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.686461 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.687313 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.702365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:36.709195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:36.716042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:36.718612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 176/348] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:36.720663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:36.784837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 173/349] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:36.787198 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3985-8faa-46e3-9bbc-2eefc8d977ac None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.787774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3985-8faa-46e3-9bbc-2eefc8d977ac None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.788282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3985-8faa-46e3-9bbc-2eefc8d977ac None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.789988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 174/350] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:36.791716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3985-8faa-46e3-9bbc-2eefc8d977ac None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:36.851320 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a14e-1b69-4846-b868-2c922eed3c99 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:36.900425 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:36.900629 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.900855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.901035 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.904263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=646c8e6add7647f0b9cd0c71b8453213) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:36.904263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:36.904263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:36.911489 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 177/351] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:36 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:36.914182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:36.942601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3985-8faa-46e3-9bbc-2eefc8d977ac None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:36.960048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:36.993131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe2217-9f8a-471a-9629-0b81b7befbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:36.994664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe2217-9f8a-471a-9629-0b81b7befbff None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:36.994948 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe2217-9f8a-471a-9629-0b81b7befbff None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:36.997993 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe2217-9f8a-471a-9629-0b81b7befbff None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:36.998887 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe2217-9f8a-471a-9629-0b81b7befbff None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:36.999496 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe2217-9f8a-471a-9629-0b81b7befbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:37.002381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe2217-9f8a-471a-9629-0b81b7befbff None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:37.004773 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:37.017980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 175/352] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:37.019597 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d045a9-c1e8-4a2a-914c-731e650b5b56 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.020029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d045a9-c1e8-4a2a-914c-731e650b5b56 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.020458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d045a9-c1e8-4a2a-914c-731e650b5b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.045299 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-53d045a9-c1e8-4a2a-914c-731e650b5b56 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:37.047272 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-53d045a9-c1e8-4a2a-914c-731e650b5b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:37.060573 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43cdc4-5171-4b0c-9e67-c18cf88cd5e7 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:37.107576 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da80a9-0b40-4b89-92d0-5272af3ac700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:37.108305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da80a9-0b40-4b89-92d0-5272af3ac700 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.108770 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da80a9-0b40-4b89-92d0-5272af3ac700 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.109054 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da80a9-0b40-4b89-92d0-5272af3ac700 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.110500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da80a9-0b40-4b89-92d0-5272af3ac700 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:37.112013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da80a9-0b40-4b89-92d0-5272af3ac700 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:37.114839 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 178/353] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:36 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:37.115594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930e83-39a2-42b4-b485-78821451ad21 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.115881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930e83-39a2-42b4-b485-78821451ad21 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.116156 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930e83-39a2-42b4-b485-78821451ad21 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.117763 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 179/354] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:37.120408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f930e83-39a2-42b4-b485-78821451ad21 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:37.146974 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 176/355] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:37.148432 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d045a9-c1e8-4a2a-914c-731e650b5b56 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:37.289921 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f930e83-39a2-42b4-b485-78821451ad21 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:37.296005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:37.300768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d045a9-c1e8-4a2a-914c-731e650b5b56 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:37.329228 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:37.335945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:37.336840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.337295 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.337871 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.351195 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d41e6-2240-47e3-a2f8-beb7a891407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:37.352012 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d41e6-2240-47e3-a2f8-beb7a891407a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.352416 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d41e6-2240-47e3-a2f8-beb7a891407a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.352797 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d41e6-2240-47e3-a2f8-beb7a891407a None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.355715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d41e6-2240-47e3-a2f8-beb7a891407a None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:37.358108 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d41e6-2240-47e3-a2f8-beb7a891407a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:37.360616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 177/356] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:37 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:37.362179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95f3e-7541-4c0f-b1b5-4abe425ab30f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.362620 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95f3e-7541-4c0f-b1b5-4abe425ab30f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.363176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc95f3e-7541-4c0f-b1b5-4abe425ab30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.388817 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-acc95f3e-7541-4c0f-b1b5-4abe425ab30f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:37.390277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-acc95f3e-7541-4c0f-b1b5-4abe425ab30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:37.461730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:37.464431 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:37.522753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 178/357] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:37.524512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95f3e-7541-4c0f-b1b5-4abe425ab30f None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:37.685161 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 180/358] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:37.686968 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:37.742867 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:37.753468 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:37.756172 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc95f3e-7541-4c0f-b1b5-4abe425ab30f None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:37.828968 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:37.830489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.831127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.831773 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.854997 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:37.860570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:37.861498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 179/359] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:37.864191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:37.896659 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ca510-1e16-411f-bff2-200721550546 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:37.951091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:37.951818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:37.952200 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:37.952595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:37.953683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=646c8e6add7647f0b9cd0c71b8453213) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:37.954734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:37.956184 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:37.963021 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 181/360] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:37 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:37.964304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:38.000579 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67bb9c-924a-4ef1-8ba4-cdb789af5155 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:38.055779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:38.057057 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.057386 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.057687 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.071622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:38.078949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:38.080025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 180/361] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:38.086654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:38.115833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:38.126431 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc4ddd-6d8d-4214-9f36-2b24c1c2df76 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:38.132876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:38.173322 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:38.174033 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.174463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.174872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.176086 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:38.177877 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:38.179647 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 182/362] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:37 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:38.180430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:38.291730 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86376ee-086f-44e3-b98e-5cd967796962 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:38.346892 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:38.347468 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.347754 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.348025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.348848 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] RBAC: Adding query filter params (name=reader) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:38.349102 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:38.352454 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:38.355535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affe75c-af0a-4f4c-91be-380bedf7b1c5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:38.370250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 181/363] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:38.370250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:38.406203 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e0f34-685e-4d9f-9561-9e8c7fd1db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:38.406952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e0f34-685e-4d9f-9561-9e8c7fd1db2c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.407178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e0f34-685e-4d9f-9561-9e8c7fd1db2c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.407455 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e0f34-685e-4d9f-9561-9e8c7fd1db2c None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.408231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e0f34-685e-4d9f-9561-9e8c7fd1db2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:38.408543 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e0f34-685e-4d9f-9561-9e8c7fd1db2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:38.410100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e0f34-685e-4d9f-9561-9e8c7fd1db2c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:38.422906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 183/364] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:38.426435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea62e8-00c8-44fe-80d2-9f351920fa8c None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.426435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea62e8-00c8-44fe-80d2-9f351920fa8c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.426435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea62e8-00c8-44fe-80d2-9f351920fa8c None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.426435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 184/365] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:38.427098 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea62e8-00c8-44fe-80d2-9f351920fa8c None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:38.468482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:38.492494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:38.522133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bb2c-9e0a-47fa-a5f0-b01d694923db None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:38.566947 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:38.567769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.568051 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.568735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.570265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:38.571707 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:38.573120 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea62e8-00c8-44fe-80d2-9f351920fa8c None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:38.574668 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 182/366] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:38 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:38.575473 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:38.635726 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3206c8-7956-4cdc-94a3-da143160d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:38.636378 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3206c8-7956-4cdc-94a3-da143160d63c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.641356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3206c8-7956-4cdc-94a3-da143160d63c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.641356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3206c8-7956-4cdc-94a3-da143160d63c None admin] PATH_INFO: `/v3/users/d172e507d84a4212836d741f293c0122` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.641356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3206c8-7956-4cdc-94a3-da143160d63c None admin] RBAC: Authorizing `identity:get_user(user_id=d172e507d84a4212836d741f293c0122)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:38.641356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3206c8-7956-4cdc-94a3-da143160d63c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:38.641356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 185/367] 10.222.0.71 () {56 vars in 1177 bytes} [Wed Jul 27 19:09:38 2022] GET /identity/v3/users/d172e507d84a4212836d741f293c0122 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:38.642467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551007-ccff-4b40-b1a1-f005016e97ff None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.642744 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551007-ccff-4b40-b1a1-f005016e97ff None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.643012 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551007-ccff-4b40-b1a1-f005016e97ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.674034 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-80551007-ccff-4b40-b1a1-f005016e97ff None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:38.675253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-80551007-ccff-4b40-b1a1-f005016e97ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:38.739188 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b6bc4-5108-49c9-9b35-bab526bd32c2 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:38.780008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 186/368] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:38.781624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80551007-ccff-4b40-b1a1-f005016e97ff None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:38.818433 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:38.818433 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:38.818433 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:38.818433 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:38.838183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:38.848002 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:38.914527 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:38.916535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:38.967056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80551007-ccff-4b40-b1a1-f005016e97ff None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:39.029024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:39.029678 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.029960 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.030231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.031046 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=91ff70ae363b4f6cabed63522d2304e6) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:39.031326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:39.032849 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:39.043309 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 187/369] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:38 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:39.043949 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:39.062307 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 183/370] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:39.062822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:39.121201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:39.186993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:39.205801 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfcd6b-32cb-4251-9a2f-0c2d98863c05 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:39.210132 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed8ada-f4c5-42a0-8bb0-0a029f2dcba6 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:39.277341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:39.278015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.278300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.278580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.279380 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] RBAC: Adding query filter params (role.id=9ad57f42e0174b04948f81a6e5d2b496, user.id=d172e507d84a4212836d741f293c0122, scope.system=all) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:39.279693 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:39.281167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:39.283528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:39.284209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.284831 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.284831 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.307158 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:39.312289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:39.313221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 184/371] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:39.314502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:39.320087 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 188/372] 10.222.0.71 () {56 vars in 1308 bytes} [Wed Jul 27 19:09:39 2022] GET /identity/v3/role_assignments?user.id=d172e507d84a4212836d741f293c0122&scope.system=all&role.id=9ad57f42e0174b04948f81a6e5d2b496 => generated 510 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:39.320943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:39.501132 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb4c4-f337-497d-8042-abc40ffd803c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:39.505436 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722515-96c3-47da-85a2-9bcc3c7a1d55 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:39.514537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:39.576412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98663a-334b-4743-886f-8623005174f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:39.577097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98663a-334b-4743-886f-8623005174f5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.578062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98663a-334b-4743-886f-8623005174f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.578339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98663a-334b-4743-886f-8623005174f5 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.579673 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:39.580306 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.580582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.580857 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.581578 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:39.581930 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:39.583307 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:39.585124 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98663a-334b-4743-886f-8623005174f5 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:39.586670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98663a-334b-4743-886f-8623005174f5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:39.589844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 185/373] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:39 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:39.598770 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98663a-334b-4743-886f-8623005174f5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:39.612263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 189/374] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:39.636899 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:39.650113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:39.809534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98663a-334b-4743-886f-8623005174f5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:39.824821 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e35d-cc6f-4625-860c-a00487c3197f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:39.860599 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3765bc-d250-4797-ba0f-faace9ad2826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:39.861277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3765bc-d250-4797-ba0f-faace9ad2826 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.861562 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3765bc-d250-4797-ba0f-faace9ad2826 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.861952 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3765bc-d250-4797-ba0f-faace9ad2826 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.863260 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3765bc-d250-4797-ba0f-faace9ad2826 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:39.866669 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3765bc-d250-4797-ba0f-faace9ad2826 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:39.867874 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 186/375] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:39 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:39.874233 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a796d1-bc5b-480d-9e2d-9921e0a363f0 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.874526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a796d1-bc5b-480d-9e2d-9921e0a363f0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.874793 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a796d1-bc5b-480d-9e2d-9921e0a363f0 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.876394 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 187/376] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:39.878860 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a796d1-bc5b-480d-9e2d-9921e0a363f0 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:39.896441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:39.897751 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:39.898445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:39.898966 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:39.933843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:40.016284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:40.017894 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:40.018409 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a796d1-bc5b-480d-9e2d-9921e0a363f0 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:40.034880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:40.066607 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48eb2-65cf-4a84-94fa-62a0ac5995c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:40.068381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48eb2-65cf-4a84-94fa-62a0ac5995c5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:40.068890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48eb2-65cf-4a84-94fa-62a0ac5995c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:40.069346 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48eb2-65cf-4a84-94fa-62a0ac5995c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:40.070349 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a48eb2-65cf-4a84-94fa-62a0ac5995c5 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=91ff70ae363b4f6cabed63522d2304e6) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:40.070889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a48eb2-65cf-4a84-94fa-62a0ac5995c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:40.072843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a48eb2-65cf-4a84-94fa-62a0ac5995c5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:40.079154 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 188/377] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:39 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:40.080215 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301946c0-a6cc-4851-b2e8-d5109678d331 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:40.080507 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301946c0-a6cc-4851-b2e8-d5109678d331 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:40.080783 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301946c0-a6cc-4851-b2e8-d5109678d331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:40.128232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-301946c0-a6cc-4851-b2e8-d5109678d331 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:40.130904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-301946c0-a6cc-4851-b2e8-d5109678d331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:40.216069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 190/378] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 19:09:40.239100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:40.265695 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 189/379] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:40.293410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301946c0-a6cc-4851-b2e8-d5109678d331 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:40.339236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:40.391772 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02d218-7567-4bc8-85cb-76ee52c130ea None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:40.403370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:40.457122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:40.459680 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:40.460914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:40.461446 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] PATH_INFO: `/v3/projects/7bac04fe952a4d2c91db90416fe41f28` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:40.464213 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] RBAC: Authorizing `identity:get_project(project_id=7bac04fe952a4d2c91db90416fe41f28)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:40.468236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301946c0-a6cc-4851-b2e8-d5109678d331 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:40.468636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:40.472265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 191/380] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:40 2022] GET /identity/v3/projects/7bac04fe952a4d2c91db90416fe41f28 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:40.478834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:40.551534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:40.552207 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:40.552483 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:40.552752 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:40.567838 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:40.573580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:40.574544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:40.575351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:40.575964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 190/381] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:40.583536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:40.642666 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f29f-0d74-4f48-bd6e-a42f15497505 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:40.696200 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:40.698065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:40.698574 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:40.699045 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] PATH_INFO: `/v3/groups/8de5daad4c7a411e856307011b7bebe7` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:40.709269 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] RBAC: Authorizing `identity:get_group(group_id=8de5daad4c7a411e856307011b7bebe7)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:40.711281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:40.713055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c3c5-4764-447f-ae10-17826f599454 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:40.718312 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 192/382] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:40 2022] GET /identity/v3/groups/8de5daad4c7a411e856307011b7bebe7 => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:40.724066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:40.730269 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:40.778420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:40.779049 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:40.779387 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:40.779751 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:40.782196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:40.782525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:40.783929 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:40.794920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 191/383] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:40.797409 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:40.807240 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:40.933778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07963d7d-f18c-46ff-84ad-66803195bead None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:40.973293 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:40.974157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:40.974444 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:40.974720 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:40.975936 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:40.977376 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:40.979976 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 192/384] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:40 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:40.987645 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:40.995818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981802b-3bfa-43da-ba28-a6a1101023f0 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:41.031983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:41.104472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:41.105171 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:41.105388 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:41.105679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:41.106479 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] RBAC: Adding query filter params (group.id=8de5daad4c7a411e856307011b7bebe7, role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=7bac04fe952a4d2c91db90416fe41f28) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:41.106791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:41.108220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:41.113936 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43477bd3-bade-4673-a31e-19343ffc7e1b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:41.124620 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 193/385] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:40 2022] GET /identity/v3/role_assignments?group.id=8de5daad4c7a411e856307011b7bebe7&scope.project.id=7bac04fe952a4d2c91db90416fe41f28&role.id=40fb60241dc645059f308de1b41e6e44 => generated 260 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:41.156643 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b8cd-e726-4383-9e24-6651b0cfdcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:41.157307 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b8cd-e726-4383-9e24-6651b0cfdcd8 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:41.157584 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b8cd-e726-4383-9e24-6651b0cfdcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:41.158021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b8cd-e726-4383-9e24-6651b0cfdcd8 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:41.159215 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046b8cd-e726-4383-9e24-6651b0cfdcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:41.160691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046b8cd-e726-4383-9e24-6651b0cfdcd8 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:41.162832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 193/386] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:40 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:41.169072 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:41.194050 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d361eb-71f8-41fd-aaa7-0426e99cdaf9 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:41.194661 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d361eb-71f8-41fd-aaa7-0426e99cdaf9 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:41.195140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d361eb-71f8-41fd-aaa7-0426e99cdaf9 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:41.197485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 194/387] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:41.203345 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393c7f-0d4b-4914-957d-85737c450191 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:41.203938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393c7f-0d4b-4914-957d-85737c450191 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:41.204418 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9393c7f-0d4b-4914-957d-85737c450191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:41.224949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e9393c7f-0d4b-4914-957d-85737c450191 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:41.227006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e9393c7f-0d4b-4914-957d-85737c450191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:41.326428 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 195/388] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:41.358046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9393c7f-0d4b-4914-957d-85737c450191 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:41.377414 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e4af-f155-4a62-be49-30cdec279462 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:41.390045 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:41.394536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:41.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:41.476817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:41.479192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:41.480621 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213/groups/ef94b0ceb3464c1b9a055591730f2321/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:41.484888 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=646c8e6add7647f0b9cd0c71b8453213, group_id=ef94b0ceb3464c1b9a055591730f2321, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:41.487689 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:41.515178 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9393c7f-0d4b-4914-957d-85737c450191 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:41.515797 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 194/389] 10.222.0.71 () {58 vars in 1442 bytes} [Wed Jul 27 19:09:41 2022] PUT /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213/groups/ef94b0ceb3464c1b9a055591730f2321/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:41.569009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:41.569692 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:41.569986 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:41.570249 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:41.591733 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:41.596806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:41.597708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:41.598544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 196/390] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:41.606566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:41.760698 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959e18-4a97-4bd6-81be-7e22ca73d1a9 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:41.816837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29d57f-9937-45d7-9381-88a6311e8f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:41.817491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d57f-9937-45d7-9381-88a6311e8f53 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:41.819408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d57f-9937-45d7-9381-88a6311e8f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:41.819408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d57f-9937-45d7-9381-88a6311e8f53 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:41.819408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29d57f-9937-45d7-9381-88a6311e8f53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:41.819408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29d57f-9937-45d7-9381-88a6311e8f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:41.820701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29d57f-9937-45d7-9381-88a6311e8f53 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:41.834711 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 195/391] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:41.841470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:41.982559 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:41.999482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caf203-0002-4ed4-a586-e3c0e15d2361 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.000170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caf203-0002-4ed4-a586-e3c0e15d2361 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.000453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caf203-0002-4ed4-a586-e3c0e15d2361 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.003321 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 196/392] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:42.005208 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae052ef-0ac7-45bf-9fe5-02bb0e25dede None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:42.009422 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975f0b-ad0f-41ec-993f-3dd70de5e3d5 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.009832 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975f0b-ad0f-41ec-993f-3dd70de5e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.011081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975f0b-ad0f-41ec-993f-3dd70de5e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.036789 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-6a975f0b-ad0f-41ec-993f-3dd70de5e3d5 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:42.038244 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-6a975f0b-ad0f-41ec-993f-3dd70de5e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:42.063205 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:42.063859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.064201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.064472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.065777 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:42.067000 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:42.067222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:42.069237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 197/393] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:41 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:42.074668 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:42.154381 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 197/394] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:42.185115 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a975f0b-ad0f-41ec-993f-3dd70de5e3d5 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:42.221965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e537ac-766b-4e14-8e0d-a411838c199d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:42.265710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:42.266301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.266689 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.266976 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.268180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:42.269681 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:42.276764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 198/395] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:42 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:42.277671 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:42.299153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a975f0b-ad0f-41ec-993f-3dd70de5e3d5 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:42.304845 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:42.339215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:42.339873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.340224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.340404 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.352500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:42.358734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:42.360158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:42.361402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:42.364732 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 198/396] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:42.366056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:42.391807 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:42.415236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ab3a-3106-4013-a612-fedb9440778e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:42.455961 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:42.457111 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.457624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.458134 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213/groups/ef94b0ceb3464c1b9a055591730f2321/roles/438e6120d45e41cb9ae73ac4bdd1750d` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.460849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] RBAC: Authorizing `identity:create_grant(project_id=646c8e6add7647f0b9cd0c71b8453213, group_id=ef94b0ceb3464c1b9a055591730f2321, role_id=438e6120d45e41cb9ae73ac4bdd1750d)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:42.463308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:42.481843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 199/397] 10.222.0.71 () {58 vars in 1442 bytes} [Wed Jul 27 19:09:42 2022] PUT /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213/groups/ef94b0ceb3464c1b9a055591730f2321/roles/438e6120d45e41cb9ae73ac4bdd1750d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:42.503506 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597672-2cc4-447b-870b-46b1a0d1669a None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:42.550540 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:42.551099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.551376 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.551654 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.552384 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:42.552684 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:42.554207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:42.570279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 199/398] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:42.571033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:42.681500 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:42.704215 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905523ca-bf0a-40ae-8d77-aeabf3b48147 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:42.745014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:42.745699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.745990 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.746269 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.747473 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:42.748943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:42.750609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 200/399] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:42 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:42.756463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:42.857833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:42.885797 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce44ffc-d456-43b3-9ca2-95b8ec636bf2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:42.925711 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4bb4f-5a61-4a76-8e54-1bdd5d14d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:42.926371 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4bb4f-5a61-4a76-8e54-1bdd5d14d844 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:42.926657 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4bb4f-5a61-4a76-8e54-1bdd5d14d844 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:42.926936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4bb4f-5a61-4a76-8e54-1bdd5d14d844 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:42.928157 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4bb4f-5a61-4a76-8e54-1bdd5d14d844 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:42.933916 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4bb4f-5a61-4a76-8e54-1bdd5d14d844 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:42.936223 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 200/400] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:42 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:42.942060 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:43.057020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974743-2e6b-461c-8767-fefadb72cc48 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:43.095502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d84e6c-5786-4634-9803-21c290f9703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:43.096192 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84e6c-5786-4634-9803-21c290f9703b None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:43.096477 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84e6c-5786-4634-9803-21c290f9703b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:43.096755 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84e6c-5786-4634-9803-21c290f9703b None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6/groups/ef94b0ceb3464c1b9a055591730f2321/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:43.098808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d84e6c-5786-4634-9803-21c290f9703b None admin] RBAC: Authorizing `identity:create_grant(project_id=91ff70ae363b4f6cabed63522d2304e6, group_id=ef94b0ceb3464c1b9a055591730f2321, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:43.100313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d84e6c-5786-4634-9803-21c290f9703b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:43.117041 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 201/401] 10.222.0.71 () {58 vars in 1442 bytes} [Wed Jul 27 19:09:42 2022] PUT /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6/groups/ef94b0ceb3464c1b9a055591730f2321/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:43.587697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147d74-89f7-4e4f-9744-a93523f49f61 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:43.588256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147d74-89f7-4e4f-9744-a93523f49f61 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:43.588256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147d74-89f7-4e4f-9744-a93523f49f61 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:43.589990 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 201/402] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:43.595391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b304d-60d2-4c75-a888-e369e00da427 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:43.595813 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b304d-60d2-4c75-a888-e369e00da427 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:43.595987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b304d-60d2-4c75-a888-e369e00da427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:43.622715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-145b304d-60d2-4c75-a888-e369e00da427 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:43.623942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-145b304d-60d2-4c75-a888-e369e00da427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:43.626185 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:43.715639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 202/403] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:43.764645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147d74-89f7-4e4f-9744-a93523f49f61 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:43.900962 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147d74-89f7-4e4f-9744-a93523f49f61 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:43.951525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8f3b-253c-4a1f-a7b1-93ea3ce0c0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:43.952184 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8f3b-253c-4a1f-a7b1-93ea3ce0c0a6 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:43.952465 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8f3b-253c-4a1f-a7b1-93ea3ce0c0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:43.952739 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8f3b-253c-4a1f-a7b1-93ea3ce0c0a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:43.974915 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8f3b-253c-4a1f-a7b1-93ea3ce0c0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-232c8f3b-253c-4a1f-a7b1-93ea3ce0c0a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:43.981355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:43.982325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:43.983580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 202/404] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:43.989139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b304d-60d2-4c75-a888-e369e00da427 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:44.130860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c80b61-dfb9-43ee-b947-d3e49b00d043 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.131141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c80b61-dfb9-43ee-b947-d3e49b00d043 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.131771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c80b61-dfb9-43ee-b947-d3e49b00d043 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.133997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 203/405] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:44.140291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b304d-60d2-4c75-a888-e369e00da427 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:44.140656 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f751ac-4021-49d7-baf5-591ae3265e96 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.141159 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f751ac-4021-49d7-baf5-591ae3265e96 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.141622 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f751ac-4021-49d7-baf5-591ae3265e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.163010 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-a0f751ac-4021-49d7-baf5-591ae3265e96 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:44.164519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-a0f751ac-4021-49d7-baf5-591ae3265e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:44.170014 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:44.207167 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:44.207808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.208089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.208363 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.209086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:44.209388 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:44.210826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:44.226485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:44.235426 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 203/406] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:44.238337 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:44.302961 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 204/407] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:44.327641 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f751ac-4021-49d7-baf5-591ae3265e96 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:44.433989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9c3d0-7b89-4a6b-b460-d7b69722c8b5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:44.501927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:44.502854 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.503294 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.503706 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.505184 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:44.506826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:44.511622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 204/408] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:44 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:44.514632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f751ac-4021-49d7-baf5-591ae3265e96 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:44.517191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:44.570427 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:44.571080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.571357 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.572563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.586026 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:44.599465 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:44.604437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:44.605353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:44.606186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 205/409] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:44.616840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:44.645782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:44.694484 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cd65c-d710-4981-b082-23d8e025fcb8 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:44.765085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:44.765777 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.766065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.766340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.770763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:44.772313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:44.774209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 205/410] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:44 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:44.788224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:44.867245 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629fb0e-f783-4879-8aeb-afd5f0bf1c3c None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:44.934782 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2885f4-32a0-4dcf-bb24-f5dd9e9eed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:44.935876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2885f4-32a0-4dcf-bb24-f5dd9e9eed9f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.936354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2885f4-32a0-4dcf-bb24-f5dd9e9eed9f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.936801 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2885f4-32a0-4dcf-bb24-f5dd9e9eed9f None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.938025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2885f4-32a0-4dcf-bb24-f5dd9e9eed9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:44.938567 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2885f4-32a0-4dcf-bb24-f5dd9e9eed9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:44.940926 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2885f4-32a0-4dcf-bb24-f5dd9e9eed9f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:44.964008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 206/411] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:44.966157 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028776-12c0-4396-b081-1f0d3824185d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:44.966619 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028776-12c0-4396-b081-1f0d3824185d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:44.967070 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028776-12c0-4396-b081-1f0d3824185d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:44.970045 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 207/412] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:44.971330 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17028776-12c0-4396-b081-1f0d3824185d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:45.036055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247880e8-ef1b-4039-a872-e37b2f2e5636 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:45.074110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:45.089085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8382de-2153-4bc7-a345-2e48292da6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:45.090434 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8382de-2153-4bc7-a345-2e48292da6b1 None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.090721 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8382de-2153-4bc7-a345-2e48292da6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.091001 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8382de-2153-4bc7-a345-2e48292da6b1 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6/groups/ef94b0ceb3464c1b9a055591730f2321/roles/438e6120d45e41cb9ae73ac4bdd1750d` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.097217 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8382de-2153-4bc7-a345-2e48292da6b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=91ff70ae363b4f6cabed63522d2304e6, group_id=ef94b0ceb3464c1b9a055591730f2321, role_id=438e6120d45e41cb9ae73ac4bdd1750d)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:45.098744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8382de-2153-4bc7-a345-2e48292da6b1 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:45.102068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:45.115906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 206/413] 10.222.0.71 () {58 vars in 1442 bytes} [Wed Jul 27 19:09:44 2022] PUT /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6/groups/ef94b0ceb3464c1b9a055591730f2321/roles/438e6120d45e41cb9ae73ac4bdd1750d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:45.117799 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e691db-4cf0-43a4-b7e8-dbbf93354a8f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.118099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e691db-4cf0-43a4-b7e8-dbbf93354a8f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.119215 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e691db-4cf0-43a4-b7e8-dbbf93354a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.146600 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17028776-12c0-4396-b081-1f0d3824185d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:45.164103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-15e691db-4cf0-43a4-b7e8-dbbf93354a8f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:45.165431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-15e691db-4cf0-43a4-b7e8-dbbf93354a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:45.214145 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:45.215048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.215473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.215890 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] PATH_INFO: `/v3/groups/8de5daad4c7a411e856307011b7bebe7` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.217525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] RBAC: Authorizing `identity:get_group(group_id=8de5daad4c7a411e856307011b7bebe7)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:45.219888 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:45.222256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 208/414] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:44 2022] GET /identity/v3/groups/8de5daad4c7a411e856307011b7bebe7 => generated 229 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:45.228209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:45.363433 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 207/415] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:45.366657 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09692e04-a056-4060-801f-0b4e3fae2a77 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:45.390795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e691db-4cf0-43a4-b7e8-dbbf93354a8f None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:45.407697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:45.409159 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.409675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.410178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] PATH_INFO: `/v3/projects/7bac04fe952a4d2c91db90416fe41f28` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.411914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] RBAC: Authorizing `identity:get_project(project_id=7bac04fe952a4d2c91db90416fe41f28)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:45.413830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:45.416699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 209/416] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:45 2022] GET /identity/v3/projects/7bac04fe952a4d2c91db90416fe41f28 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:45.420173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:45.422980 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:45.525196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e691db-4cf0-43a4-b7e8-dbbf93354a8f None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:45.560015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:45.571722 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ca272-89ef-431e-81a3-dc350d699dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:45.572471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ca272-89ef-431e-81a3-dc350d699dd4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.572829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ca272-89ef-431e-81a3-dc350d699dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.573419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ca272-89ef-431e-81a3-dc350d699dd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.580418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635020e-4162-4a5a-8b84-e1bd70309010 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:45.587704 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ca272-89ef-431e-81a3-dc350d699dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-847ca272-89ef-431e-81a3-dc350d699dd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:45.595216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:45.596339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:45.597327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:45.601795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 208/417] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:45.601795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036145e0-3a44-4982-a51d-8be53a8cf9c5 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.601795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036145e0-3a44-4982-a51d-8be53a8cf9c5 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.601795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036145e0-3a44-4982-a51d-8be53a8cf9c5 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.605749 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 209/418] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:45.606953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036145e0-3a44-4982-a51d-8be53a8cf9c5 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:45.638894 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955387c-c7bc-4ff6-a158-68d486da80e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:45.639429 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955387c-c7bc-4ff6-a158-68d486da80e9 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.639505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955387c-c7bc-4ff6-a158-68d486da80e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.639770 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955387c-c7bc-4ff6-a158-68d486da80e9 None admin] PATH_INFO: `/v3/projects/7bac04fe952a4d2c91db90416fe41f28/groups/8de5daad4c7a411e856307011b7bebe7/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.642076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955387c-c7bc-4ff6-a158-68d486da80e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bac04fe952a4d2c91db90416fe41f28, group_id=8de5daad4c7a411e856307011b7bebe7, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:45.643852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955387c-c7bc-4ff6-a158-68d486da80e9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:45.663017 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 210/419] 10.222.0.71 () {58 vars in 1442 bytes} [Wed Jul 27 19:09:45 2022] PUT /identity/v3/projects/7bac04fe952a4d2c91db90416fe41f28/groups/8de5daad4c7a411e856307011b7bebe7/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:45.664032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868068f3-8c0e-4733-b270-1db3b68a6e95 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.664355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868068f3-8c0e-4733-b270-1db3b68a6e95 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.664582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868068f3-8c0e-4733-b270-1db3b68a6e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.691331 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-868068f3-8c0e-4733-b270-1db3b68a6e95 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:45.693028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-868068f3-8c0e-4733-b270-1db3b68a6e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:45.760737 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036145e0-3a44-4982-a51d-8be53a8cf9c5 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:45.807959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:45.808967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:45.809495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:45.809999 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:45.810946 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:45.811523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:45.814586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:45.827609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 210/420] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:45.835521 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:45.838060 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:45.874686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 211/421] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:45.908698 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868068f3-8c0e-4733-b270-1db3b68a6e95 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:45.945125 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:46.029798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec27e0-b19e-4b25-81f1-6e04a83c2b16 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.070865 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868068f3-8c0e-4733-b270-1db3b68a6e95 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.076454 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.077099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.077378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.077686 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.111852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68111ee3-42b3-4be0-92eb-387069f92273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.112514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68111ee3-42b3-4be0-92eb-387069f92273 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.112794 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68111ee3-42b3-4be0-92eb-387069f92273 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.113069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68111ee3-42b3-4be0-92eb-387069f92273 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.136474 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68111ee3-42b3-4be0-92eb-387069f92273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-68111ee3-42b3-4be0-92eb-387069f92273 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:46.141450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:46.142524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:46.143337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 212/422] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:46.150020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59410b0-32bf-422f-a046-862a042ebba9 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.150020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59410b0-32bf-422f-a046-862a042ebba9 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.150020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59410b0-32bf-422f-a046-862a042ebba9 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.150020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 213/423] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:46.150020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59410b0-32bf-422f-a046-862a042ebba9 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:46.204394 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:46.206097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:46.215372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:46.282492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:46.286753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59410b0-32bf-422f-a046-862a042ebba9 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.327750 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ef79d-c99d-40fd-a177-35bb595405f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.328481 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ef79d-c99d-40fd-a177-35bb595405f1 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.328831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ef79d-c99d-40fd-a177-35bb595405f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.329106 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ef79d-c99d-40fd-a177-35bb595405f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.329946 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ef79d-c99d-40fd-a177-35bb595405f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:46.330186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ef79d-c99d-40fd-a177-35bb595405f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:46.331881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ef79d-c99d-40fd-a177-35bb595405f1 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:46.346187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 214/424] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:46.346187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368c6ee-63ff-4870-83b8-721856c0e4c9 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.346187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368c6ee-63ff-4870-83b8-721856c0e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.346187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368c6ee-63ff-4870-83b8-721856c0e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.352548 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 211/425] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:46.354503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:46.363747 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-9368c6ee-63ff-4870-83b8-721856c0e4c9 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:46.364997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9368c6ee-63ff-4870-83b8-721856c0e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:46.454551 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 215/426] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:46.454551 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368c6ee-63ff-4870-83b8-721856c0e4c9 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:46.500047 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29d63c-e8b6-4ea1-8f49-ea23c4b13cd9 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.502216 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:46.538740 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.539380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.539662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.539937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.560007 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:46.582556 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368c6ee-63ff-4870-83b8-721856c0e4c9 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.616281 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:46.617629 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:46.622617 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.623594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.624083 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.624563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.626058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:46.627730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:46.630053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 216/427] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:46.631042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:46.744349 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 212/428] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:46.744349 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:46.751749 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075776c-b2c4-4de1-ba71-c947de5e8802 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.755040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:46.791958 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.792993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.793479 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.793972 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.795341 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:46.806663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:46.811917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:46.812829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 19:09:46.813745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:46.821367 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 217/429] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:46.823118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:46.856922 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39f33-2a41-447f-b5fa-5ed46312b45e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.894672 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.895330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.895618 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.895894 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.897179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:46.898571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:46.900591 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 213/430] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:46.901484 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:46.937674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9df57-7738-4ab6-a1ab-13a74a83a2aa None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:46.974567 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:46.975599 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:46.976080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:46.976561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] PATH_INFO: `/v3/projects/646c8e6add7647f0b9cd0c71b8453213` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:46.978528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] RBAC: Authorizing `identity:get_project(project_id=646c8e6add7647f0b9cd0c71b8453213)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:46.980293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:46.987005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 218/431] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/projects/646c8e6add7647f0b9cd0c71b8453213 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:46.988149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:47.011743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae50f1-3325-4248-a098-b3c4323ef0f9 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:47.023289 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:47.031375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:47.054616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:47.055222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.055448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.055731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.057153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] RBAC: Adding query filter params (name=member) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:47.057459 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:47.059146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:47.073680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 214/432] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:47.073680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:47.115558 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea91d67-2378-4aa2-a590-ff616c816333 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:47.156026 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:47.157026 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.157518 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.158004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.159081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=646c8e6add7647f0b9cd0c71b8453213) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:47.159778 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:47.161528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:47.168888 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 219/433] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:46 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:47.170221 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:47.187445 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f4c65-648a-4626-9b6e-9d91bd9983af None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:47.235217 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:47.235901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.236288 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.236571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.238786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:47.240382 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:47.242529 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 215/434] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:47 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:47.258752 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:47.329182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:47.337624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960425ef-87d6-4249-b60a-ee68fb641383 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:47.363447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:47.379071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40890ab-1cb9-4b2b-9429-ecb7457e15d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:47.380113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40890ab-1cb9-4b2b-9429-ecb7457e15d2 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.380684 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40890ab-1cb9-4b2b-9429-ecb7457e15d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.381216 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40890ab-1cb9-4b2b-9429-ecb7457e15d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.433548 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c98862-dfb5-4c86-bc7e-ffd039ac4615 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:47.465718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40890ab-1cb9-4b2b-9429-ecb7457e15d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:47.467617 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40890ab-1cb9-4b2b-9429-ecb7457e15d2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:47.474262 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:47.474903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.475191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.475472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.476274 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=646c8e6add7647f0b9cd0c71b8453213) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:47.476587 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:47.478639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:47.485480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 216/435] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:47 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=646c8e6add7647f0b9cd0c71b8453213&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:47.598375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:47.604845 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 220/436] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:47.612803 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:47.749179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399e99c-5d27-47e1-838f-ad6302077948 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:47.764757 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:47.773836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001b1c-a68c-47a4-9909-700a6d9e6b83 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.774361 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001b1c-a68c-47a4-9909-700a6d9e6b83 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.774437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6001b1c-a68c-47a4-9909-700a6d9e6b83 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.776387 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 221/437] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:47.783064 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaacdb-1ecc-48bc-9ce6-0ce051ff003a None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.783354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaacdb-1ecc-48bc-9ce6-0ce051ff003a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.783626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaacdb-1ecc-48bc-9ce6-0ce051ff003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.793114 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:47.793810 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.794097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:47.794442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:47.795570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:47.797011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:47.799037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 217/438] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:47 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:47.805466 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:47.814865 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-ecaaacdb-1ecc-48bc-9ce6-0ce051ff003a None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:47.816073 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-ecaaacdb-1ecc-48bc-9ce6-0ce051ff003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:47.927560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 222/439] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:47.951998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516764ef-64fd-48c5-8be2-a559dd00994f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:47.952747 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaacdb-1ecc-48bc-9ce6-0ce051ff003a None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:47.998411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:47.999420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:47.999814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.009415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.010481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:48.011901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:48.013880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 218/440] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:47 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:48.019602 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.085065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:48.104622 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaacdb-1ecc-48bc-9ce6-0ce051ff003a None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:48.140706 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:48.153211 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:48.154237 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.154664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.155211 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.168772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fa091-7f1c-4529-995a-d7cd3c5b44d7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:48.173038 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:48.178173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:48.179131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:48.179944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 223/441] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:09:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:48.188291 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.217025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c940a-9807-4ef7-a578-d04fce11ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:48.218071 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c940a-9807-4ef7-a578-d04fce11ee99 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.218530 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c940a-9807-4ef7-a578-d04fce11ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.218989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c940a-9807-4ef7-a578-d04fce11ee99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.219975 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c940a-9807-4ef7-a578-d04fce11ee99 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=e01dafa93d884a19adb7866841e6ca91, scope.project.id=91ff70ae363b4f6cabed63522d2304e6) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:48.220512 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c940a-9807-4ef7-a578-d04fce11ee99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:48.222188 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c940a-9807-4ef7-a578-d04fce11ee99 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:48.229553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 219/442] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=e01dafa93d884a19adb7866841e6ca91 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:48.313375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a0318-ac92-423b-ba31-4d9b76886ec9 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:48.334748 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb315ae-ec83-4f79-9f37-56bb7177118b None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.335056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb315ae-ec83-4f79-9f37-56bb7177118b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.335299 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb315ae-ec83-4f79-9f37-56bb7177118b None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.336682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 220/443] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:09:48.343267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36677f7-fb2b-43db-a186-1dd1fb4156d5 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.343555 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36677f7-fb2b-43db-a186-1dd1fb4156d5 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.343836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36677f7-fb2b-43db-a186-1dd1fb4156d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.359462 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:48.360410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.360693 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.360977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.361741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:48.362057 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:48.363458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:48.363744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-f36677f7-fb2b-43db-a186-1dd1fb4156d5 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:48.364977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f36677f7-fb2b-43db-a186-1dd1fb4156d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:48.374966 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 224/444] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:48.380964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.439679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:48.452436 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 221/445] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:48.477238 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36677f7-fb2b-43db-a186-1dd1fb4156d5 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.504854 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5bc7e-304e-4433-8ebc-e379b20d3b7d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:48.530735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:48.553041 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:48.554334 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.554334 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.554692 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.608199 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36677f7-fb2b-43db-a186-1dd1fb4156d5 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:48.638696 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:48.640049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:48.650423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:48.650423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.652064 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.652411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.676026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:48.681317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:48.682375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:48.683334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 222/446] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:09:48.688298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.730461 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:48.786377 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 225/447] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:48.792820 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.806329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:48.812073 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0ef3b-a11c-472d-ab53-cc2911658ba4 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:48.864476 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:48.865363 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.865847 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.866316 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.867533 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:48.868014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:48.871122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:48.883804 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 223/448] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:48.890156 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.925181 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62cd77-42da-4f9a-9c11-062dc3a9227a None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:48.962938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:48.963618 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:48.963897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:48.964176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] PATH_INFO: `/v3/projects/91ff70ae363b4f6cabed63522d2304e6` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:48.965349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] RBAC: Authorizing `identity:get_project(project_id=91ff70ae363b4f6cabed63522d2304e6)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:48.966804 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:48.968452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 226/449] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/projects/91ff70ae363b4f6cabed63522d2304e6 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:48.973961 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:48.992997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:48.998183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb77c26-127c-4eca-83af-b13834d82f8a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:49.032308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:49.032937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:49.033219 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:49.033494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:49.065159 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:49.077049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68cb97-753d-46e5-93c8-68608de01702 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:49.104766 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:49.106254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:49.113043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:49.113707 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:49.113991 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:49.114265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] PATH_INFO: `/v3/groups/ef94b0ceb3464c1b9a055591730f2321` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:49.115475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] RBAC: Authorizing `identity:get_group(group_id=ef94b0ceb3464c1b9a055591730f2321)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:49.116851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:49.118871 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 227/450] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/groups/ef94b0ceb3464c1b9a055591730f2321 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:49.124631 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:49.206785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 224/451] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 19:09:49.209300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:49.213165 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:49.225937 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b74a4f-613d-4924-baa8-a4ab15044356 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:49.259603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:49.260413 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:49.260692 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:49.260968 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:49.262153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] RBAC: Adding query filter params (group.id=ef94b0ceb3464c1b9a055591730f2321, role.id=438e6120d45e41cb9ae73ac4bdd1750d, scope.project.id=91ff70ae363b4f6cabed63522d2304e6) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:49.262502 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:49.264028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:49.270629 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 228/452] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:49 2022] GET /identity/v3/role_assignments?group.id=ef94b0ceb3464c1b9a055591730f2321&scope.project.id=91ff70ae363b4f6cabed63522d2304e6&role.id=438e6120d45e41cb9ae73ac4bdd1750d => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:49.279309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:49.320859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9914-6a99-49fc-b999-a7eb85a9e71c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:49.359537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:49.360198 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:49.360482 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:49.360760 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] PATH_INFO: `/v3/projects/7bac04fe952a4d2c91db90416fe41f28` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:49.362017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] RBAC: Authorizing `identity:get_project(project_id=7bac04fe952a4d2c91db90416fe41f28)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:49.363474 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:49.365223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 225/453] 10.222.0.71 () {56 vars in 1186 bytes} [Wed Jul 27 19:09:49 2022] GET /identity/v3/projects/7bac04fe952a4d2c91db90416fe41f28 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:49.371924 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:49.481148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ec04-4ba7-4059-b68e-13810e0bdd52 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:49.516021 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbd289-1628-485a-8a76-c9bd9afc7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:49.516666 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbd289-1628-485a-8a76-c9bd9afc7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:49.516954 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbd289-1628-485a-8a76-c9bd9afc7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:49.517245 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbd289-1628-485a-8a76-c9bd9afc7fd9 None admin] PATH_INFO: `/v3/groups/8de5daad4c7a411e856307011b7bebe7` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:49.518398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbd289-1628-485a-8a76-c9bd9afc7fd9 None admin] RBAC: Authorizing `identity:get_group(group_id=8de5daad4c7a411e856307011b7bebe7)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:49.519832 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbd289-1628-485a-8a76-c9bd9afc7fd9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:49.521418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 229/454] 10.222.0.71 () {56 vars in 1180 bytes} [Wed Jul 27 19:09:49 2022] GET /identity/v3/groups/8de5daad4c7a411e856307011b7bebe7 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:49.528133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:49.638070 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21262caa-5fca-4492-a7de-3dfaf1884a1e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:49.667340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:49.673522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ea553-595e-4ff3-9966-7eb205ea862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:49.674166 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea553-595e-4ff3-9966-7eb205ea862a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:49.674450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea553-595e-4ff3-9966-7eb205ea862a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:49.674726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ea553-595e-4ff3-9966-7eb205ea862a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:49.675511 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ea553-595e-4ff3-9966-7eb205ea862a None admin] RBAC: Adding query filter params (group.id=8de5daad4c7a411e856307011b7bebe7, role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=7bac04fe952a4d2c91db90416fe41f28) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:49.675819 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ea553-595e-4ff3-9966-7eb205ea862a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:49.677243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ea553-595e-4ff3-9966-7eb205ea862a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:49.683472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 226/455] 10.222.0.71 () {56 vars in 1376 bytes} [Wed Jul 27 19:09:49 2022] GET /identity/v3/role_assignments?group.id=8de5daad4c7a411e856307011b7bebe7&scope.project.id=7bac04fe952a4d2c91db90416fe41f28&role.id=40fb60241dc645059f308de1b41e6e44 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:52.309467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab8c71-e8e1-4a55-b3d6-ffe94de016b4 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.309467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab8c71-e8e1-4a55-b3d6-ffe94de016b4 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.309467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab8c71-e8e1-4a55-b3d6-ffe94de016b4 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.310421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 230/456] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:52.316084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb4e5-46ff-4572-819e-994b54db81d1 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.316900 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb4e5-46ff-4572-819e-994b54db81d1 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.317397 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb4e5-46ff-4572-819e-994b54db81d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.338247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-4d2fb4e5-46ff-4572-819e-994b54db81d1 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:52.339976 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-4d2fb4e5-46ff-4572-819e-994b54db81d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:52.423505 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 227/457] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:52.449429 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab8c71-e8e1-4a55-b3d6-ffe94de016b4 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:52.476202 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:52.552121 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0be5-0d93-4e13-b0f7-c676cbfc6b17 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.552457 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0be5-0d93-4e13-b0f7-c676cbfc6b17 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.552692 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0be5-0d93-4e13-b0f7-c676cbfc6b17 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.554410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 228/458] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:52.560727 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f95ff-f92a-4a4f-9629-3a4b54294f7b None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.560987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f95ff-f92a-4a4f-9629-3a4b54294f7b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.561208 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f95ff-f92a-4a4f-9629-3a4b54294f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.580228 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab8c71-e8e1-4a55-b3d6-ffe94de016b4 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:52.581833 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-753f95ff-f92a-4a4f-9629-3a4b54294f7b None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:52.584010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-753f95ff-f92a-4a4f-9629-3a4b54294f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:52.619316 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53694668-a961-4a0e-b567-d0cc5e191951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:52.619964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694668-a961-4a0e-b567-d0cc5e191951 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.620303 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694668-a961-4a0e-b567-d0cc5e191951 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.620520 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53694668-a961-4a0e-b567-d0cc5e191951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.631766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53694668-a961-4a0e-b567-d0cc5e191951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:52.633112 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53694668-a961-4a0e-b567-d0cc5e191951 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-53694668-a961-4a0e-b567-d0cc5e191951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:52.648944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:52.650049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:52.651078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:52.651078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:52.651078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:52.651078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:52.651078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 231/459] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:52.651822 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a8793-1660-4b39-9816-8e73014ff41c None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.653195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a8793-1660-4b39-9816-8e73014ff41c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.653195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a8793-1660-4b39-9816-8e73014ff41c None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.653622 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 232/460] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:52.656015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a8793-1660-4b39-9816-8e73014ff41c None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:52.664124 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 229/461] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:52.666346 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fc4c3-e726-4261-9a0d-0b1eb28a5fa8 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.666641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fc4c3-e726-4261-9a0d-0b1eb28a5fa8 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.666919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fc4c3-e726-4261-9a0d-0b1eb28a5fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.686492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e71fc4c3-e726-4261-9a0d-0b1eb28a5fa8 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:52.688173 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e71fc4c3-e726-4261-9a0d-0b1eb28a5fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:52.742827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:52.752260 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:52.774932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 230/462] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:52.776214 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fc4c3-e726-4261-9a0d-0b1eb28a5fa8 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:52.796127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a8793-1660-4b39-9816-8e73014ff41c None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:52.840637 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:52.841224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.841526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.841838 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.842635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:52.842964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:52.844338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:52.858808 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 233/463] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:52.859444 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:52.892411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fc4c3-e726-4261-9a0d-0b1eb28a5fa8 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:52.929397 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:52.930096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:52.930381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:52.931354 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:52.942610 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:52.944074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:52.961439 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:52.963570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:52.964550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:52.964550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:52.964550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:52.964550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:52.964550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 231/464] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:52.965049 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:52.989973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0da72-feb3-4282-8b2c-227badfa7aaf None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.004542 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:53.018083 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:53.027196 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.027868 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.028154 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.028422 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.038626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.040623 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:53.055699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:53.057150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:53.058042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:53.058042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:53.058042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:53.058042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:53.058042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 234/465] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:53.058302 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:53.075167 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a102-8596-4807-857f-ee9f50ecd171 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.112413 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdf30b-bc41-42a7-80bd-c92d0b17e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.113153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf30b-bc41-42a7-80bd-c92d0b17e6ea None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.113426 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf30b-bc41-42a7-80bd-c92d0b17e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.113745 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf30b-bc41-42a7-80bd-c92d0b17e6ea None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.114464 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdf30b-bc41-42a7-80bd-c92d0b17e6ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.115882 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdf30b-bc41-42a7-80bd-c92d0b17e6ea None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:53.140128 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 232/466] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:52 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:53.141544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6007a-fbff-4676-ae9f-c01c792a941b None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.141868 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6007a-fbff-4676-ae9f-c01c792a941b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.142152 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6007a-fbff-4676-ae9f-c01c792a941b None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.143411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 233/467] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:53.144143 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6007a-fbff-4676-ae9f-c01c792a941b None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:53.179860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390036-fc26-40b9-89e8-c8d0e9ed4897 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.222594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5b98b-1fd5-4e9c-9534-1a1f61cdaadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.223244 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b98b-1fd5-4e9c-9534-1a1f61cdaadd None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.223526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b98b-1fd5-4e9c-9534-1a1f61cdaadd None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.223804 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b98b-1fd5-4e9c-9534-1a1f61cdaadd None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.224514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5b98b-1fd5-4e9c-9534-1a1f61cdaadd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:53.224822 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5b98b-1fd5-4e9c-9534-1a1f61cdaadd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.226355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5b98b-1fd5-4e9c-9534-1a1f61cdaadd None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:53.246522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 235/468] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:53.246522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6909c-a3ef-4803-8103-0ec89da9f553 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.246522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6909c-a3ef-4803-8103-0ec89da9f553 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.246522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6909c-a3ef-4803-8103-0ec89da9f553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.266634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-c0b6909c-a3ef-4803-8103-0ec89da9f553 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:53.267901 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-c0b6909c-a3ef-4803-8103-0ec89da9f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:53.268890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:53.282638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6007a-fbff-4676-ae9f-c01c792a941b None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.312376 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:53.328506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.329372 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.329714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.330053 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.330790 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:53.331374 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.332630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:53.353126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 234/469] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:53.354080 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:53.355003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 236/470] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:53.359092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6909c-a3ef-4803-8103-0ec89da9f553 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:53.475458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6909c-a3ef-4803-8103-0ec89da9f553 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.479649 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213ddcc-a730-4e43-bab0-3fda27f1c6c7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.514327 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.514952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.515227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.515499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.516174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.517301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.517600 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:53.517966 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.518253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.518532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.519217 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.520641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:53.545807 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 237/471] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:53 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:53.545807 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:53.557432 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 235/472] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:53 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:53.590942 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:53.690360 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba6a7-629a-437b-92dc-248290d30be2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.743569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.744641 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.745129 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.745698 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.761117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.762703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:53.779779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:53.780873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:53.782174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:53.782174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:53.782174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:53.782174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:53.782174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 238/473] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:53.789674 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:53.803933 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:53.922822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4104b-6433-486c-a3fc-808e7e3076d2 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:53.981166 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709b51b-3a44-4e69-a3b4-5047167c8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:53.982152 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b51b-3a44-4e69-a3b4-5047167c8e35 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:53.982587 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b51b-3a44-4e69-a3b4-5047167c8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:53.983034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b51b-3a44-4e69-a3b4-5047167c8e35 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:53.983894 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709b51b-3a44-4e69-a3b4-5047167c8e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:53.984346 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709b51b-3a44-4e69-a3b4-5047167c8e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:53.985919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709b51b-3a44-4e69-a3b4-5047167c8e35 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:54.002923 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 236/474] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:54.009518 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:54.109542 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:54.138643 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938a9da-fa3e-4299-bff5-098f6ffd1326 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:54.185904 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a4c8a-92a0-4203-a963-cf2641d54cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:54.186782 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4c8a-92a0-4203-a963-cf2641d54cfd None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:54.187236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4c8a-92a0-4203-a963-cf2641d54cfd None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:54.187655 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4c8a-92a0-4203-a963-cf2641d54cfd None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:54.188557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4c8a-92a0-4203-a963-cf2641d54cfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:54.190193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4c8a-92a0-4203-a963-cf2641d54cfd None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:54.215105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 239/475] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:09:54 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:09:55.762645 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165b4a3-ef77-462d-abd9-e0d5b5dd9016 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:55.763222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165b4a3-ef77-462d-abd9-e0d5b5dd9016 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:55.763222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165b4a3-ef77-462d-abd9-e0d5b5dd9016 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:55.764861 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 237/476] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:55.770864 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442118-3480-46d4-91c0-93df4855bbf6 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:55.771353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442118-3480-46d4-91c0-93df4855bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:55.771450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442118-3480-46d4-91c0-93df4855bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:55.791646 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-ca442118-3480-46d4-91c0-93df4855bbf6 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:55.792872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-ca442118-3480-46d4-91c0-93df4855bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:55.874464 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 240/477] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:55.899240 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165b4a3-ef77-462d-abd9-e0d5b5dd9016 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:55.982265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:55.990640 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48afef4-5a28-4250-b00c-2b8c407b83b2 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:55.991243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48afef4-5a28-4250-b00c-2b8c407b83b2 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:55.991712 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48afef4-5a28-4250-b00c-2b8c407b83b2 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:55.994057 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 241/478] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:55.999834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f09fb-18cd-4f6c-a558-4299731de0f4 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.000436 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f09fb-18cd-4f6c-a558-4299731de0f4 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.000902 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f09fb-18cd-4f6c-a558-4299731de0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.020969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-4c0f09fb-18cd-4f6c-a558-4299731de0f4 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:56.022705 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-4c0f09fb-18cd-4f6c-a558-4299731de0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:56.031791 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165b4a3-ef77-462d-abd9-e0d5b5dd9016 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.081015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.081775 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.081964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.082227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.094600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:56.099915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:56.100849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:56.101633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 238/479] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:56.109845 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:56.110015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.110255 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 242/480] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:09:56.128955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f09fb-18cd-4f6c-a558-4299731de0f4 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.232378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be933a08-4400-4b3d-9a72-f04ddc78c00c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.249600 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f09fb-18cd-4f6c-a558-4299731de0f4 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.272296 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:56.284199 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a7373-7f9d-4974-8cc0-ca2af61402d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.285192 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7373-7f9d-4974-8cc0-ca2af61402d4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.285570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7373-7f9d-4974-8cc0-ca2af61402d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.285888 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a7373-7f9d-4974-8cc0-ca2af61402d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.286616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7373-7f9d-4974-8cc0-ca2af61402d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:56.286919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7373-7f9d-4974-8cc0-ca2af61402d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:56.288301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a7373-7f9d-4974-8cc0-ca2af61402d4 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:56.290780 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ea0de-8872-4653-981c-8a484a261425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.291442 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea0de-8872-4653-981c-8a484a261425 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.291723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea0de-8872-4653-981c-8a484a261425 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.292000 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea0de-8872-4653-981c-8a484a261425 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.298279 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 239/481] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:09:56.299791 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcbb16-cae1-4ee9-a969-c64f49a1145c None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.300084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcbb16-cae1-4ee9-a969-c64f49a1145c None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.300356 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcbb16-cae1-4ee9-a969-c64f49a1145c None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.301784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 240/482] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:56.306953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcbb16-cae1-4ee9-a969-c64f49a1145c None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.309399 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ea0de-8872-4653-981c-8a484a261425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-362ea0de-8872-4653-981c-8a484a261425 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:56.314492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:56.322565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 243/483] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:56.323525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ef38-e979-4072-8049-796031c79a8b None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.324234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ef38-e979-4072-8049-796031c79a8b None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.324234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ef38-e979-4072-8049-796031c79a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.341071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-b182ef38-e979-4072-8049-796031c79a8b None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:56.342280 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-b182ef38-e979-4072-8049-796031c79a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:56.409340 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:56.435259 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 244/484] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:56.438796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ef38-e979-4072-8049-796031c79a8b None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.452969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcbb16-cae1-4ee9-a969-c64f49a1145c None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.494014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.494696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.494974 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.495249 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.507513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:56.509039 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:56.525312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:56.526421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:56.532170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:56.532170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:56.532170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:56.532170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:56.532170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 241/485] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:56.532170 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.566563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ef38-e979-4072-8049-796031c79a8b None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.588845 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:56.605553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.606491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.606954 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.607225 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.608110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:56.608239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:56.609612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:56.622084 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 245/486] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:56.627420 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.668246 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9163db4-05c4-4479-b2bc-03fb751ecfe7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.684405 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:56.703763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.704405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.704684 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.704952 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.715731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:56.721127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:56.722232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 242/487] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:56.731292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.746088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430d77-02c0-4631-8917-9daac55fd0a9 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.787214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5812097-3750-4715-afab-788e4cd4a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.787880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812097-3750-4715-afab-788e4cd4a51d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.788073 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812097-3750-4715-afab-788e4cd4a51d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.788347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812097-3750-4715-afab-788e4cd4a51d None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.789050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5812097-3750-4715-afab-788e4cd4a51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:56.789352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5812097-3750-4715-afab-788e4cd4a51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:56.791437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5812097-3750-4715-afab-788e4cd4a51d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:56.804319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 246/488] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:56.806359 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb36770-854d-40d9-a05e-1902d8e18ab4 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.806643 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb36770-854d-40d9-a05e-1902d8e18ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.806911 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb36770-854d-40d9-a05e-1902d8e18ab4 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.808341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 247/489] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:09:56.808884 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb36770-854d-40d9-a05e-1902d8e18ab4 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.836425 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86983f0-307f-4032-8bfc-2d7c93375c22 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.838153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:56.872384 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f262f8e-a2e5-4b72-b2d5-019b6ba4837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.873030 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262f8e-a2e5-4b72-b2d5-019b6ba4837f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.873318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262f8e-a2e5-4b72-b2d5-019b6ba4837f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.873584 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262f8e-a2e5-4b72-b2d5-019b6ba4837f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.884698 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f262f8e-a2e5-4b72-b2d5-019b6ba4837f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:56.886206 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f262f8e-a2e5-4b72-b2d5-019b6ba4837f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-2f262f8e-a2e5-4b72-b2d5-019b6ba4837f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:56.901109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:56.902116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:56.902989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:56.902989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:56.902989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:56.902989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:56.902989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 243/490] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:56.903453 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2132-4f6d-456b-9520-f053267c5a25 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.903736 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2132-4f6d-456b-9520-f053267c5a25 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.904010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2132-4f6d-456b-9520-f053267c5a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.919016 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb36770-854d-40d9-a05e-1902d8e18ab4 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:56.923446 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-4bae2132-4f6d-456b-9520-f053267c5a25 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:56.924659 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-4bae2132-4f6d-456b-9520-f053267c5a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:56.926511 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:56.954673 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:56.955320 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:56.955596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:56.955866 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:56.956562 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:56.956859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:56.958276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:56.966622 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 248/491] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:56.967433 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:56.994218 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 244/492] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:09:56.995062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2132-4f6d-456b-9520-f053267c5a25 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.074756 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0782-e1df-4c3f-bb07-35d3f51520d5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.092331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.108525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2132-4f6d-456b-9520-f053267c5a25 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.109473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.110165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.110442 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.110716 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.119187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.120754 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:09:57.134595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:57.136155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 249/493] 10.222.0.71 () {56 vars in 1093 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:57.137472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.145719 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.146350 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.146635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.146915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.147619 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:57.147920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.149359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.161081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 245/494] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:57.161947 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.173025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.248915 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a77d3-d895-4fb7-a331-066ff5ca66fc None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.265446 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3674b3-c074-4a99-9eb7-9bd632b03fcf None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.283730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.284373 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.284653 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.284925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.295527 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.296993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.299829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.300468 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.300744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.301019 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:57.311430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:57.312469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:57.318298 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:57.318298 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:57.318298 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:57.318298 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:57.318526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:09:57.318603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 250/495] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:57.318603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:09:57.318731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:57.319525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 246/496] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:57.320322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.327808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.398548 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.418495 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47c058-d331-40e2-99fd-4c72476d25ef None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.427089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546b35e-07dd-4615-9b01-b6143db5c1f0 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.455151 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.455783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.456064 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.456339 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.457148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:57.457459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.459018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.464613 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.465259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.465540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.465861 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.474096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.475588 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:09:57.494055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:57.495092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 247/497] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:57.496017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.501243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 251/498] 10.222.0.71 () {56 vars in 1133 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:57.502268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.564216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.605169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb5602-bfe0-41b0-bfcc-bc2705f90830 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.606227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c91ab-acc6-4bf0-92b2-ed9c1691ebb2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.639969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.640588 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.640840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.640950 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.641136 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.641459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.641777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.641870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:57.642056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.642171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.642763 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:57.643066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.643520 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.644424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.650155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.653775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 252/499] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:57.655400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.661449 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 248/500] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:57.661449 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.760673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba80f-361b-49c7-9294-fa91f7563547 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.763470 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fb23c-6be4-48f4-aa49-8727b88b8406 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.784339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.796372 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.796994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.797276 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.797373 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.797975 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.798065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.798294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.798561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.799344 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:57.799646 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.801066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.818352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 253/501] 10.222.0.71 () {56 vars in 1137 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:57.819153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.866630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.868812 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.878697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:57.919808 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fdf2b-a2e9-47f9-9388-aaf7514a3807 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:57.955114 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:57.955743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:57.956017 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:57.956293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:57.966122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:57.967557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:57.968443 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 249/502] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:57.969063 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:57.983193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:57.984141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:57.985235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:57.985235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:57.985235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:57.985235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:57.985235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 254/503] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:57.985235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:57.997638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.083558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4a1d-cde4-4bc8-83ff-ee2d65e09643 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.090621 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1109-4529-479b-810c-66f6666c3220 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.100875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.126269 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.126796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.127077 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.127345 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.129275 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.129956 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.130237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.130510 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.138458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.139917 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:09:58.155480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:58.156638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 250/504] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:58.157768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.203581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.205050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.251982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.269364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f37b7-7bd3-413c-8fa9-f018cf232231 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.304319 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.304970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.305257 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.306176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.311081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 255/505] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:58.311926 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.319747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.321334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.323421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:58.338077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:58.339187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:58.340223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:58.340223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:58.340223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:58.340223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:58.340223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 251/506] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:58.340223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.426389 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7529f05-b3b3-403c-9963-4d1e13307463 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.448214 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18792e2e-6f6c-4a27-9bc1-c38e0fc2614b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.463842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.464464 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.464740 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.465008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.465722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:58.466030 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.467386 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.479437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 256/507] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:58.480250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.488881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.489504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.489830 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.490730 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.490895 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:58.491206 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.492651 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.505167 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.531549 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 252/508] 10.222.0.71 () {56 vars in 1137 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:58.532393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.553516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.585784 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910795ad-04d6-43fa-bd49-ab88a4402dbe None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.620979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.621614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.621928 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.622198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.632775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.634438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.635279 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedea21-beb1-4a3f-be7a-99095b638b29 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:58.648512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:58.649973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:58.650912 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:58.650912 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:58.650912 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:58.650912 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:58.650912 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 257/509] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:58.651182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.677060 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.677601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.677914 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.678191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.678906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:58.679213 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.681266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.692660 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 253/510] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:58.693492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.753508 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.757713 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e353a8-ae48-4eca-ad97-f44833a69b72 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.780915 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.793508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.794190 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.794472 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.794754 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.800316 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4718fd-b6aa-4f72-a89e-6f4c1a9ccde9 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.802988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.804432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:09:58.815957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:58.816992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 258/511] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:58.818375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:58.838479 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.839103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.839387 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.839661 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.908616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.910117 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.924142 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6e477-aec2-4424-a7f5-6d334d416bb5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:58.957972 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:58.958513 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:58.958797 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:58.959071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:58.959752 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:58.960056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:58.961419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:58.965770 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:58.973820 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 259/512] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:58.974644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.018228 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 254/513] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:59.019064 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.023211 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.076433 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfe573-3c20-4c14-a7f6-489021c88a3d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.110147 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.110779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.111055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.111324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.118358 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.119461 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9435-b7bf-472f-8189-d57c3711608a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.120015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:09:59.131819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:59.133040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:59.134220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 260/514] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:59.134744 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.161233 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.162942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.162942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.162942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.163340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:59.163552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.165989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.187860 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 255/515] 10.222.0.71 () {56 vars in 1139 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:59.188823 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.203449 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.251599 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073910c-d486-4d93-889a-8bff7d5053bd None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.253611 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.287898 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.288532 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.288816 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.289092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.293360 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411abcc-0ff7-42f1-b399-ba2558d0827c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.296555 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.298031 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:09:59.309508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:59.310424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:09:59.311272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 261/516] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:59.311728 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.331773 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.332414 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.332699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.332980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.343506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.345029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:09:59.360352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:09:59.361277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:09:59.362155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:09:59.362155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:09:59.362155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:09:59.362155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:09:59.362155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 256/517] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:09:59.362416 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.414162 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6f8a2-459a-412b-bea0-67ed6676ca97 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.424302 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.448959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.449586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.449894 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.450168 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.450906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:59.451210 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.452647 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.464393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1661884-65ca-47ed-866e-f6abbc2b2eff None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.472117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 262/518] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:59.472931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.498042 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.503978 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.504532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.504810 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.505081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.572899 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.574425 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.579444 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701390-c3e1-4cd4-bee7-13c5ea472f5b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.614440 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.615046 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.615325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.615594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.616332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:59.616630 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.618439 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.629732 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 263/519] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:59.630525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.638442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.678135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 257/520] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:09:59.678985 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.716195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.734876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0051b-7c8c-4e54-a1ab-0b1dd4013488 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.773889 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.776187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.776480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.776762 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.777557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:59.777914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.779720 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.780556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c5ad8-de13-401c-a641-b0ac76339ee4 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.793798 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 264/521] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:59.794654 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.815270 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.815883 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.816163 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.816433 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.817205 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=059d420dbd794b8badd367bdb41ee2d6) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:59.817509 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.818977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.832331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 258/522] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/role_assignments?user.id=059d420dbd794b8badd367bdb41ee2d6&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:59.832331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:59.859425 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:59.929776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f12cd0-2cc0-47e4-a824-13695bbff26d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.941325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6dd64-76e9-452a-8809-823628fb94c7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:59.971486 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.972117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.972503 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.972784 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.973751 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=7605bd73b8204acba28a144a64d5eee7) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:09:59.974066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:59.975531 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:59.979690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:59.980355 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:59.980639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:59.980917 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:59.983458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 265/523] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/role_assignments?user.id=7605bd73b8204acba28a144a64d5eee7&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:09:59.984679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:00.001218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:00.005796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.007759 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:00.040994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:00.042447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:00.043304 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:00.043304 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:00.043304 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:00.043304 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:00.043304 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 259/524] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:00.044206 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:00.153075 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647101f-3b57-42ac-8f34-2508ef580f99 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:00.178052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:00.204327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23675f8-f28a-4f03-91fc-030bcded89e0 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:00.206222 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:00.207048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:00.207335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:00.207609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:00.216266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.219860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:00.235897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:00.236836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:00.237791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 266/525] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:00.246826 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:00.248769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:00.249635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:00.250181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:00.250670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:00.251556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:00.252062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.253622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.279779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 260/526] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:00.281048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:00.343724 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:00.398253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efd5f6-ec1f-46b0-9761-236550e670c4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:00.398963 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf999-1b75-4057-b48a-3f881145fda1 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:00.438925 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:00.439560 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:00.439841 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:00.440110 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:00.449672 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:00.450317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:00.450564 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:00.450828 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:00.451563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:00.451863 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.453281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.454719 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.456930 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.459856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:00.472234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 267/527] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:00.473936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:00.475412 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:00.476259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:00.478118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:00.482378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 261/528] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:00.483305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:00.592884 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c1453-2ef9-4768-afc4-5d4762f2d09e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:00.613099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d282c7-6397-432b-a411-affc05f9c4f9 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:00.631234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:00.631854 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:00.632133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:00.632407 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:00.633143 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:00.634184 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.635663 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.650182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:00.660912 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 262/529] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:00.661921 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:00.664120 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549e66f-a724-407a-a886-94f7f2cbed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:00.666761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e66f-a724-407a-a886-94f7f2cbed74 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:00.667304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e66f-a724-407a-a886-94f7f2cbed74 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:00.667787 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e66f-a724-407a-a886-94f7f2cbed74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:00.668855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549e66f-a724-407a-a886-94f7f2cbed74 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=0421ec636a1545329ad46308ef451145) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:00.669372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549e66f-a724-407a-a886-94f7f2cbed74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.671682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549e66f-a724-407a-a886-94f7f2cbed74 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.685909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 268/530] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:00 2022] GET /identity/v3/role_assignments?user.id=0421ec636a1545329ad46308ef451145&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:00.745952 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:00.792120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b110-1302-4e47-bc66-806ad618dc79 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:00.830760 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e795df6-c4a9-46bc-854d-e08084f4cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:00.831391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795df6-c4a9-46bc-854d-e08084f4cb1b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:00.831676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795df6-c4a9-46bc-854d-e08084f4cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:00.831954 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795df6-c4a9-46bc-854d-e08084f4cb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:00.832759 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e795df6-c4a9-46bc-854d-e08084f4cb1b None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=d6d1644bffa94434900353bf4a2fecea) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:00.833071 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e795df6-c4a9-46bc-854d-e08084f4cb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:00.834569 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e795df6-c4a9-46bc-854d-e08084f4cb1b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:00.841910 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 263/531] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:00 2022] GET /identity/v3/role_assignments?user.id=d6d1644bffa94434900353bf4a2fecea&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:02.154857 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630018-d033-40c6-b444-608ee006ef43 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.155392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630018-d033-40c6-b444-608ee006ef43 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.155392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30630018-d033-40c6-b444-608ee006ef43 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.157155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 269/532] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:02.163064 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db578d6-f802-4d41-bc0b-f5dad13cb4e3 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.163572 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db578d6-f802-4d41-bc0b-f5dad13cb4e3 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.163647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db578d6-f802-4d41-bc0b-f5dad13cb4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.183772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-5db578d6-f802-4d41-bc0b-f5dad13cb4e3 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:02.184986 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-5db578d6-f802-4d41-bc0b-f5dad13cb4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:02.255361 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 264/533] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:02.280125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30630018-d033-40c6-b444-608ee006ef43 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:02.304797 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c668ba-6272-4b26-b3d5-15e0b41289b3 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.305714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c668ba-6272-4b26-b3d5-15e0b41289b3 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.305975 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c668ba-6272-4b26-b3d5-15e0b41289b3 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.307406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 265/534] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:10:02.312551 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b003-abde-42b5-b469-6265fdd5ceec None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.313095 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b003-abde-42b5-b469-6265fdd5ceec None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.313584 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b003-abde-42b5-b469-6265fdd5ceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.332981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-bd92b003-abde-42b5-b469-6265fdd5ceec None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:02.334770 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-bd92b003-abde-42b5-b469-6265fdd5ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:02.402875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30630018-d033-40c6-b444-608ee006ef43 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:02.404618 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:02.438071 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 266/535] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:10:02.447905 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:02.448561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.448844 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.449122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.458623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92b003-abde-42b5-b469-6265fdd5ceec None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:02.461300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:02.469292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:02.470268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:02.471082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:02.474588 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 270/536] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:02.481139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:02.534535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:02.572798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92b003-abde-42b5-b469-6265fdd5ceec None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:02.590354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577dc1-5493-4a28-beb3-c1069c7fc820 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:02.610872 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:02.611890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.612390 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.612875 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.625608 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:02.627882 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:02.628512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.628803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.629080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.629844 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:02.630154 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:02.631518 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:02.632964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:02.634465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:02.635289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:02.642811 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 271/537] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:02.642962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 267/538] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:02.644211 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:02.649108 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:02.699929 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:02.767394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd170a-e4e8-4ede-ad44-43bd73a7f576 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:02.773447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69afb-749b-49a9-999c-f70923c34331 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:02.781701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:02.808706 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:02.809986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.810795 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.811257 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.812852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:02.813357 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:02.815899 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:02.819647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:02.820378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:02.821261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:02.821612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:02.827817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 272/539] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:02.834008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:02.840650 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:02.842636 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:02.860622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:02.861535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:02.862438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:02.862438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:02.862438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:02.862438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:02.866821 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 268/540] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:02.868614 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:02.975136 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51bbbc-0f86-480d-9c0b-3cd7293b329b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:02.997589 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.008760 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4aaf3-4c26-4a2e-8ce1-1ca8520965ca None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.017749 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.018600 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.018720 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.019006 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.031394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.032862 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:03.048510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:03.049419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:03.050282 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:03.050282 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:03.050282 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:03.050282 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:03.053987 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 273/541] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:03.055803 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.056143 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.057024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.057522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.058027 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.059267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:03.059779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.062402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.080109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 269/542] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:03.086223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.089783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.168352 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4bbc2-f794-4a96-bdad-437be55b0d21 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.198556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106876-f1dd-40f0-aa24-c4301c008ba6 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.205429 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a8f4f-5d44-467b-bb02-1adef852a60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.206080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a8f4f-5d44-467b-bb02-1adef852a60c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.206375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a8f4f-5d44-467b-bb02-1adef852a60c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.206633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a8f4f-5d44-467b-bb02-1adef852a60c None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.207315 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a8f4f-5d44-467b-bb02-1adef852a60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:03.207616 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a8f4f-5d44-467b-bb02-1adef852a60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.208970 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a8f4f-5d44-467b-bb02-1adef852a60c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.221996 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 274/543] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:03.223240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0881-d13e-4501-99bb-eb9130711e5f None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.223579 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0881-d13e-4501-99bb-eb9130711e5f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.223936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0881-d13e-4501-99bb-eb9130711e5f None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.225190 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 275/544] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:03.226201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b42880-38b4-4482-93dc-d46695f6b1fe None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.226505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b42880-38b4-4482-93dc-d46695f6b1fe None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.226787 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b42880-38b4-4482-93dc-d46695f6b1fe None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.232341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 276/545] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:03.232341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b42880-38b4-4482-93dc-d46695f6b1fe None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.245330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4794180-c6b6-41dd-91f9-9c60d2b30fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.245987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794180-c6b6-41dd-91f9-9c60d2b30fda None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.246326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794180-c6b6-41dd-91f9-9c60d2b30fda None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.246603 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794180-c6b6-41dd-91f9-9c60d2b30fda None admin] PATH_INFO: `/v3/users/nova` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.253951 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4794180-c6b6-41dd-91f9-9c60d2b30fda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.255387 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4794180-c6b6-41dd-91f9-9c60d2b30fda None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-a4794180-c6b6-41dd-91f9-9c60d2b30fda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:03.267782 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:03.268697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:03.269633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:03.271589 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 270/546] 10.222.0.71 () {56 vars in 1093 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:03.272836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37e21-86e2-4d92-b5a2-5778c6682713 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.273123 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37e21-86e2-4d92-b5a2-5778c6682713 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.273489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37e21-86e2-4d92-b5a2-5778c6682713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.291635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-1da37e21-86e2-4d92-b5a2-5778c6682713 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:03.292990 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-1da37e21-86e2-4d92-b5a2-5778c6682713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:03.304103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.317536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.333793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b42880-38b4-4482-93dc-d46695f6b1fe None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.362717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 271/547] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:03.364108 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d66bb-ed2e-491b-8544-6a61674358c4 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.364424 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d66bb-ed2e-491b-8544-6a61674358c4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.364670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d66bb-ed2e-491b-8544-6a61674358c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.368522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.369181 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.369458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.369743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.377958 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.379392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.383843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-898d66bb-ed2e-491b-8544-6a61674358c4 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:03.385181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-898d66bb-ed2e-491b-8544-6a61674358c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:03.392167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:03.393148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 277/548] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:03.394234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.456414 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 272/549] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:03.457254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d66bb-ed2e-491b-8544-6a61674358c4 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.507335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bae4e-cf12-4e7c-a3dc-37b414e2e076 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.533591 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.544515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.545383 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.545676 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.545953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.546739 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:03.547041 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.548451 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.559794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d66bb-ed2e-491b-8544-6a61674358c4 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.566573 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 278/550] 10.222.0.71 () {56 vars in 1133 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:03.567355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.571195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.595479 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.596126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.596406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.596678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.607226 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:03.612180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:03.613282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 273/551] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:03.620380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.672914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddf5bd-a8d4-4f3d-b341-396f33a3e248 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.708203 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.708819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.709098 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.709378 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.710191 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:03.710494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.712836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.721716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee52da-0477-4304-a086-131fd7d5da46 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.731650 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 279/552] 10.222.0.71 () {56 vars in 1137 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:03.732569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.756436 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.757196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.757698 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.757992 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.761307 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.769982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:03.776033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:03.777127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 274/553] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:03.778177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.798901 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:03.843733 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d8f1a-c925-4ce8-9062-d45bb2fd053b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.879418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.880047 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.880323 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.880591 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.884066 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d39fa9-0b0b-4abc-93cb-59d0e8e9d1e2 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:03.891341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.892773 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:03.907337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:03.908391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:03.909390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:03.909390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:03.909390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:03.909390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:03.909390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 280/554] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:03.909390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.921343 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:03.921759 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:03.922099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:03.922313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:03.923013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] RBAC: Adding query filter params (name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:03.923312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:03.924682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:03.933323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 275/555] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:03.934137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:03.991704 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.014226 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa42d06-748f-49c0-bfc2-989c615ab067 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.027592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.034407 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5d65-a997-498c-b435-10e930b20f03 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.048493 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.049132 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.049414 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.049716 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.060615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.062084 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.067626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.068247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.068528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.068802 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.069504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:04.069839 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.072352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:04.076950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:04.077971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:04.084058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:04.084058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:04.084058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:04.084058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:04.084058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 281/556] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:04.084058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.084453 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 276/557] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:04.084453 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.183881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292535-ad5f-4885-bc05-c0994678117c None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.184468 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec151fa2-1878-4682-8411-81d773d1a2d3 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.206369 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.222056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.222703 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.222986 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.223291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.226565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.228153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.228432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.228703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.229391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:04.229792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.231155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.235432 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.236880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.244193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 282/558] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:04.244987 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:04.252522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:04.254034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:04.254970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:04.254970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:04.254970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:04.254970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:04.254970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 277/559] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:04.254970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.276483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.351519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97e92e-47de-4517-8c80-64296bc0ecc4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.360350 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6c7cf-182d-42f8-b5cb-03ffead90dd9 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.387282 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.387896 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.388164 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.388421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.389102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:04.389406 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.390811 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.394209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.394845 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.395125 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.395395 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.403055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 283/560] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:04.403945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.411829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.413348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:04.428318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:04.429460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:04.431328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:04.431328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:04.431328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:04.431328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:04.431328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 278/561] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:04.431328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.455932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.494339 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.509106 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93cef8-2e3c-44a3-b780-3cd27d7562c3 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.532794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed9072-c6fb-422c-9a41-c9e19e9a7e0b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.543070 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.543705 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.543981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.544250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.551060 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.552475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:04.563723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:04.564745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 284/562] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:04.566076 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.571261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.571968 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.572181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.572458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.573153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:04.573457 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.574867 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.587693 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 279/563] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:04.588491 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.670368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b16900-ba99-4fdf-9056-996be421904e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.676465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.693862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5226-d1d1-451c-9ee5-1a13da21dd6a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.704743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.705424 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.705724 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.705999 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.713150 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.714596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:04.726170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:04.727823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:04.729036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:04.733945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 285/564] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:04.734726 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.734863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.735411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.735693 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.735967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.736660 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:04.736963 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.738357 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.745231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.751041 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 280/565] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:04.751921 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.837895 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa0d3-53c7-418d-aafb-d35b104f0de0 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.856838 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e41e8d-de7c-4157-8079-d31720a0de4d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:04.872263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.872919 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.873146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.873448 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.874224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:04.874519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.875931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.892910 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 286/566] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:04.892910 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.894796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:04.895442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:04.895725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:04.895996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:04.905072 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:04.906538 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:04.917685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:04.918795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:04.919774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 281/567] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:04.920378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:04.923171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.959493 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:04.994530 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810bb4-6b3e-4599-a270-7f4403bedc42 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.026073 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91abeb-c796-4ba7-a408-874a7cd78fe5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.029496 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.030214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.030496 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.030775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.031521 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:05.031831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.033276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.047713 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 287/568] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:05.048494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.063477 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.064116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.064391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.064681 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.072735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.074415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:05.085373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:05.086581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 282/569] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:05.092715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.151552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:05.154268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0030-3903-478b-91e8-1489411d1d56 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.178903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:05.187868 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.188536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.188816 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.189086 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] PATH_INFO: `/v3/projects/074f3318a4b34aac85f631b95f159c12/users/059d420dbd794b8badd367bdb41ee2d6/roles/88c688e9f05a469ba708f1481876f10c` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.191276 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bce05-7967-44d6-9e0c-bd76c6882cdc None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.206483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] RBAC: Authorizing `identity:create_grant(project_id=074f3318a4b34aac85f631b95f159c12, user_id=059d420dbd794b8badd367bdb41ee2d6, role_id=88c688e9f05a469ba708f1481876f10c)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.207935 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.221963 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 288/570] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:10:05 2022] PUT /identity/v3/projects/074f3318a4b34aac85f631b95f159c12/users/059d420dbd794b8badd367bdb41ee2d6/roles/88c688e9f05a469ba708f1481876f10c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:10:05.222884 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.240546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.241870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.242160 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.242656 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.243978 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:05.244307 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.245958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.274626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 283/571] 10.222.0.71 () {56 vars in 1137 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:05.275735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.353538 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595587-7c17-433b-b6ae-5ebbc6292aba None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.393749 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.394436 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.394726 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.395005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] PATH_INFO: `/v3/projects/074f3318a4b34aac85f631b95f159c12/users/7605bd73b8204acba28a144a64d5eee7/roles/88c688e9f05a469ba708f1481876f10c` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.399147 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8caef-1c19-4ef0-8031-6f9b30b18ab8 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.414133 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=074f3318a4b34aac85f631b95f159c12, user_id=7605bd73b8204acba28a144a64d5eee7, role_id=88c688e9f05a469ba708f1481876f10c)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.416445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.429139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:05.433179 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 289/572] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:10:05 2022] PUT /identity/v3/projects/074f3318a4b34aac85f631b95f159c12/users/7605bd73b8204acba28a144a64d5eee7/roles/88c688e9f05a469ba708f1481876f10c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:10:05.434265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.443955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.445004 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.445438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.446475 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.447636 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:05.448251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.450100 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.473326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 284/573] 10.222.0.71 () {56 vars in 1139 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:05.477957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:05.481064 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.575999 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e630c-4908-45e6-a0c1-8944bc2c38a4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.611667 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b114583-9c4f-459a-a1dd-695806326164 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.618735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.619774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.620200 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.620691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.632457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.634779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:05.651874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:05.652817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:05.653730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:05.653730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:05.653730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:05.653730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:05.653730 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 290/574] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:05.659858 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.659983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.659983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.660222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.660641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.677046 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.678789 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:05.702832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:05.703981 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:05.705097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:05.705097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:05.705097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:05.705097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:05.706065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 285/575] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:05.711847 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.757320 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:05.770810 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:05.797796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303bc39-9895-4f02-9682-a92170431d66 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.846675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.847898 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.848586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.849023 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.850048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:05.850504 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.853739 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.854234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc98188-5b39-48e5-9d5b-1e085b323f46 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:05.871861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 291/576] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:05.876761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:05.892236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:05.893025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:05.893406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:05.893810 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:05.894599 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:05.895002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:05.896538 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:05.915744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 286/577] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:05.916879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:06.028185 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:06.032154 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62622-2edd-4297-bddd-e22d51f0d9ff None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:06.042212 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114b15-6034-48f4-b79a-b64b3200d7fe None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:06.070889 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:06.071535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:06.072242 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:06.072242 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:06.079427 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:06.081032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:06.082972 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:06.090972 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:06.091826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:06.092255 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:06.092672 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:06.095929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:06.097004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:06.098163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:06.100014 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 292/578] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:06.105330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:06.105932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:06.107141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:06.121816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:06.122960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:06.124056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:06.127381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 287/579] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:06.133159 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:06.226145 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799ad29-9154-46cc-be5e-000b883af340 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:06.270119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:06.270742 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:06.271018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:06.271308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:06.272024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:06.272324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:06.274299 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:06.274888 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6706c8a-417c-4744-b113-000ee8251cac None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:06.292122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 293/580] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:06.293362 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:06.315878 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:06.316506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:06.316786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:06.317063 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:06.317833 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:06.318136 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:06.319575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:06.338152 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 288/581] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:06.340870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:06.361393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:06.374850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:06.430619 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289ceb3-6754-4461-a2e6-728a990ffecd None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:06.479686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7dc59-6298-42e6-9638-eb4969086131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:06.480393 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7dc59-6298-42e6-9638-eb4969086131 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:06.480679 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7dc59-6298-42e6-9638-eb4969086131 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:06.480952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7dc59-6298-42e6-9638-eb4969086131 None admin] PATH_INFO: `/v3/projects/074f3318a4b34aac85f631b95f159c12/users/0421ec636a1545329ad46308ef451145/roles/88c688e9f05a469ba708f1481876f10c` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:06.484109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a76c6-7ec0-4be1-8306-7bb0aed31c47 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:06.500688 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7dc59-6298-42e6-9638-eb4969086131 None admin] RBAC: Authorizing `identity:create_grant(project_id=074f3318a4b34aac85f631b95f159c12, user_id=0421ec636a1545329ad46308ef451145, role_id=88c688e9f05a469ba708f1481876f10c)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:06.502525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7dc59-6298-42e6-9638-eb4969086131 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:06.521727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 294/582] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:10:06 2022] PUT /identity/v3/projects/074f3318a4b34aac85f631b95f159c12/users/0421ec636a1545329ad46308ef451145/roles/88c688e9f05a469ba708f1481876f10c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:10:06.529179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fedcdc-535b-4251-9c19-db2b41793da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:06.530299 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedcdc-535b-4251-9c19-db2b41793da7 None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:06.530862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedcdc-535b-4251-9c19-db2b41793da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:06.531334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedcdc-535b-4251-9c19-db2b41793da7 None admin] PATH_INFO: `/v3/projects/074f3318a4b34aac85f631b95f159c12/users/d6d1644bffa94434900353bf4a2fecea/roles/88c688e9f05a469ba708f1481876f10c` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:06.550364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fedcdc-535b-4251-9c19-db2b41793da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=074f3318a4b34aac85f631b95f159c12, user_id=d6d1644bffa94434900353bf4a2fecea, role_id=88c688e9f05a469ba708f1481876f10c)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:06.552321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fedcdc-535b-4251-9c19-db2b41793da7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:06.569395 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 289/583] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:10:06 2022] PUT /identity/v3/projects/074f3318a4b34aac85f631b95f159c12/users/d6d1644bffa94434900353bf4a2fecea/roles/88c688e9f05a469ba708f1481876f10c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:10:07.542269 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4260-75d4-40ae-8ebd-823a19fe7aae None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:07.542836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4260-75d4-40ae-8ebd-823a19fe7aae None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:07.542836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4260-75d4-40ae-8ebd-823a19fe7aae None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:07.544388 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 295/584] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:07.549532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13c5e-0ca4-421a-b4a1-77e047dc3ae2 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:07.549942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13c5e-0ca4-421a-b4a1-77e047dc3ae2 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:07.550122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13c5e-0ca4-421a-b4a1-77e047dc3ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:07.570179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-83f13c5e-0ca4-421a-b4a1-77e047dc3ae2 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:07.571445 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-83f13c5e-0ca4-421a-b4a1-77e047dc3ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:07.633901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:07.646273 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 290/585] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:07.670697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e4260-75d4-40ae-8ebd-823a19fe7aae None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:07.788004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e4260-75d4-40ae-8ebd-823a19fe7aae None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:07.799317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:07.825139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1e687-36e9-48cd-a2f5-0207602589ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:07.825816 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e687-36e9-48cd-a2f5-0207602589ef None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:07.826096 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e687-36e9-48cd-a2f5-0207602589ef None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:07.826368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e687-36e9-48cd-a2f5-0207602589ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:07.839942 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1e687-36e9-48cd-a2f5-0207602589ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-adf1e687-36e9-48cd-a2f5-0207602589ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:07.843516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:07.844491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:07.846645 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 296/586] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:07.850704 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13c5e-0ca4-421a-b4a1-77e047dc3ae2 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:07.891889 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51315-5548-409b-9908-8d01ff23b25d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:07.892206 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51315-5548-409b-9908-8d01ff23b25d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:07.892447 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51315-5548-409b-9908-8d01ff23b25d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:07.894069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 297/587] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:10:07.900243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b470f8-b833-4305-8e3a-2f583d7a2f66 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:07.900534 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b470f8-b833-4305-8e3a-2f583d7a2f66 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:07.900813 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b470f8-b833-4305-8e3a-2f583d7a2f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:07.922718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-77b470f8-b833-4305-8e3a-2f583d7a2f66 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:07.924050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-77b470f8-b833-4305-8e3a-2f583d7a2f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:07.971777 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13c5e-0ca4-421a-b4a1-77e047dc3ae2 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.013743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 298/588] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:10:08.018866 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.019727 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.020262 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.020747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.021735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] RBAC: Adding query filter params (name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:08.022234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.024094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.033096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 291/589] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:08.041502 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b470f8-b833-4305-8e3a-2f583d7a2f66 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.041692 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.097909 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.147654 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab7774-763e-4b52-a965-c912f1f67e4c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.165603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.169821 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b470f8-b833-4305-8e3a-2f583d7a2f66 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.195279 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.196980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.197799 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.198542 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.208390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.208945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.209224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.209491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.213994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.215999 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.221071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:08.226178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:08.227176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:08.228649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 299/590] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:08.235647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:08.236543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:08.237429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:08.237429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:08.237429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:08.237429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:08.239264 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 292/591] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:08.243207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.247947 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.364108 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337d4f5-6741-4754-b0bf-305ae0030143 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.388234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd5c4b-f4b2-4c9d-8f84-3e765133cb9b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.402558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.404446 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.405390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.405932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.406607 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.407515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:08.407992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.409554 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.424189 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 300/592] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:08.425438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.435281 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.435926 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.436262 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.436543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.437869 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:08.438178 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.439564 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.453197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.458632 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 293/593] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:08.465667 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.552164 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a866e82-3af9-43d3-8ea4-5326efac7731 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.589311 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.590349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.590876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.591359 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.592682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a127-a3c0-4980-9b3a-00af4f7bd6f3 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.604756 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.606657 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:08.624037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:08.624959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:08.625913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:08.625913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:08.625913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:08.625913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:08.632475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 301/594] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:08.632629 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.634062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.634499 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.634783 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.635320 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.642814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.644279 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:08.657903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:08.658890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:08.659873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:08.663892 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 294/595] 10.222.0.71 () {56 vars in 1093 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:08.666177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.698117 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.720412 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.758691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371c1e9-8635-4ceb-ba88-dd470adc2d6a None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.798909 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90b5f6-c4d6-45fa-b355-5e5850834c2b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.799117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.800094 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.800560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.801082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.802242 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:08.802792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.804483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.825983 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 302/596] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:08.829318 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.840889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.841692 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.842133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.842548 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.843492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:08.843950 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.845836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:08.866221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 295/597] 10.222.0.71 () {56 vars in 1133 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:08.873487 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:08.949670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17442645-f268-4f69-b260-7317732f16c9 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.972163 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.981851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:08.987656 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942418-2370-49f8-910f-c0b02b4aaabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:08.988308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942418-2370-49f8-910f-c0b02b4aaabe None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:08.988658 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942418-2370-49f8-910f-c0b02b4aaabe None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:08.988860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942418-2370-49f8-910f-c0b02b4aaabe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:08.989625 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89941a8f-6e7c-4893-a284-271c4efc252d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:08.996993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942418-2370-49f8-910f-c0b02b4aaabe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:08.998474 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942418-2370-49f8-910f-c0b02b4aaabe None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-21942418-2370-49f8-910f-c0b02b4aaabe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:09.010372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:09.011385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:09.012336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 303/598] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:09.012955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c603e-6e9b-4296-83d7-4b5a7fa9944c None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.013453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c603e-6e9b-4296-83d7-4b5a7fa9944c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.013453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c603e-6e9b-4296-83d7-4b5a7fa9944c None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.014868 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 304/599] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:09.015748 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9b318-375a-4510-9ad6-76a44e7f6dfb None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.016126 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9b318-375a-4510-9ad6-76a44e7f6dfb None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.016353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9b318-375a-4510-9ad6-76a44e7f6dfb None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.018030 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 305/600] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:09.018256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9b318-375a-4510-9ad6-76a44e7f6dfb None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.029004 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184f561-298b-43bd-b3be-f458b6094a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.029633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184f561-298b-43bd-b3be-f458b6094a39 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.029954 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184f561-298b-43bd-b3be-f458b6094a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.030235 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184f561-298b-43bd-b3be-f458b6094a39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.096546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184f561-298b-43bd-b3be-f458b6094a39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:09.098021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184f561-298b-43bd-b3be-f458b6094a39 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.121381 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9b318-375a-4510-9ad6-76a44e7f6dfb None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.155194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd11dc-8892-47ec-9779-2fc9d77ee2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.155814 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd11dc-8892-47ec-9779-2fc9d77ee2f3 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.156091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd11dc-8892-47ec-9779-2fc9d77ee2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.156362 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd11dc-8892-47ec-9779-2fc9d77ee2f3 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.157147 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd11dc-8892-47ec-9779-2fc9d77ee2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:09.157451 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd11dc-8892-47ec-9779-2fc9d77ee2f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:09.158973 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd11dc-8892-47ec-9779-2fc9d77ee2f3 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.176610 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 306/601] 10.222.0.71 () {56 vars in 1137 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:09.177935 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80054e-54b7-4107-8d71-bd7872929431 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.178223 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80054e-54b7-4107-8d71-bd7872929431 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.178501 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80054e-54b7-4107-8d71-bd7872929431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.182464 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.197144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-4c80054e-54b7-4107-8d71-bd7872929431 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:09.198370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-4c80054e-54b7-4107-8d71-bd7872929431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:09.201766 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 296/602] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:10:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:10:09.202956 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64132d4-1fe8-4ced-b81b-4901d536ce69 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.203257 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64132d4-1fe8-4ced-b81b-4901d536ce69 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.203523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64132d4-1fe8-4ced-b81b-4901d536ce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.221621 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-f64132d4-1fe8-4ced-b81b-4901d536ce69 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:09.222838 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f64132d4-1fe8-4ced-b81b-4901d536ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:09.245949 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.276997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 307/603] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:09.278044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80054e-54b7-4107-8d71-bd7872929431 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.302342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 297/604] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:09.303192 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64132d4-1fe8-4ced-b81b-4901d536ce69 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.382428 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80054e-54b7-4107-8d71-bd7872929431 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.412533 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64132d4-1fe8-4ced-b81b-4901d536ce69 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.418639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.419255 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.419535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.419806 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.427963 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.450987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.451630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.451963 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.452189 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.462477 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:09.463913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.469003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:09.479828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:09.480859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:09.486592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:09.486592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:09.486592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:09.486592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:09.486592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 298/605] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:09.486592 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.489775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:09.491229 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.584208 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958671bd-29cb-4369-8178-eb59e3b434b7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.591561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 308/606] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:10:09.592401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.620575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.621218 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.621500 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.621807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.631825 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:09.638113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:09.639032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:09.639857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 299/607] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:09.640542 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.667902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.681632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.703787 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f2eda-7d44-47b1-8b70-e5bb4b17df00 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.743264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.743911 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.744183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.744452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.749118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e2e4-7645-4ada-a267-c5bf8b9a22cd None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.754738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:09.760370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:09.761482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 309/608] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:09.767317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.783315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.784007 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.784268 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.784689 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.785389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:09.785734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:09.787303 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.800004 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 300/609] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:09.800824 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.867288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735cae0-5ae3-4fc4-bab5-fd2fd087e810 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.893619 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.904249 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.904892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.905172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.905447 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.910065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1b579-845c-4ba7-aeb6-abe570deb959 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:09.913767 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:09.916994 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:09.918918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:09.938266 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:09.939319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:09.940218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:09.940218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:09.940218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:09.940218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:09.940441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 310/610] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:09.941382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:09.948684 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:09.949339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:09.949621 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:09.949926 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:09.950642 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] RBAC: Adding query filter params (name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:09.950967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:09.952325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:09.960699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 301/611] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:09.962609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.045162 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc178-1131-4605-b31b-6f88863e593e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.063772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5967fac-0568-49c3-b536-8e4e102776eb None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.080051 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.080675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.080957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.081234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.081981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:10.082284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.083650 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.092462 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 311/612] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:10.093285 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.103988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.104743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.105034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.105313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.112177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.113624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:10.124955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:10.125881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:10.126779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 302/613] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:10.127259 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.138852 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.157524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.204465 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270382-389b-4c97-a119-c87e321c7b11 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.233261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ca4bc-7554-45e9-b053-36b765f0b117 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.238654 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.239306 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.239567 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.239842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.240536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:10.240840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.242260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.254540 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 312/614] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:10.255339 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.282853 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.283793 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.284080 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.284355 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.295174 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.296623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:10.310920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:10.311837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:10.312734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:10.312734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:10.312734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:10.312734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:10.312734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 303/615] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:10.313025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.359774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a4301-ac8e-4f88-a3f5-dc0e877e77d0 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.375873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.376846 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.401207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.402038 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.402320 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.402595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.413284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.415331 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.422694 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec35a-e8b7-4376-88ba-14c178b5e915 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:10.431124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:10.432102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:10.432995 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:10.432995 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:10.432995 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:10.432995 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:10.432995 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 313/616] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:10.433278 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.466298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.466920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.467197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.467469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.468211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:10.468515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.469974 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.482956 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 304/617] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:10.483852 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.545971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afa57-155f-4c31-93f7-b6fe632d1e9b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.579817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.580458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.580739 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.581017 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.588237 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.589688 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.591470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40a7e2-fc0b-4df5-9c53-f208efcac37f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:10.600951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:10.603013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 314/618] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:10.603918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.618599 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.634541 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.634738 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.635352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.635629 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.635901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.636702 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:10.637039 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.638469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.649821 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 305/619] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:10.650624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.712766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08751c4e-7ee1-48f1-af0f-5697a884c85e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.747423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.748057 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.748349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.748617 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.749309 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:10.749616 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.751003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.758596 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3020a-a54d-43f3-8910-103f7d002857 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.763417 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 315/620] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:10.764236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.794326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.794943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.795223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.795495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.796323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=059d420dbd794b8badd367bdb41ee2d6) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:10.796638 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.798119 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.803841 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 306/621] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/role_assignments?user.id=059d420dbd794b8badd367bdb41ee2d6&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:10.804618 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.857333 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.881579 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:10.901829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4d13-eb31-4d7c-9cfd-82f5a6398111 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.923482 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a8dc-e3e4-4802-bd36-6b7491f31663 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:10.960732 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.961575 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.961979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.962604 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:10.963391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:10.963693 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:10.965165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:10.984278 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 316/622] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:10.985307 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:10.987881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:10.987881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:10.988128 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:10.988334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:11.002716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:11.006089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:11.022960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:11.024089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 19:10:11.025068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:11.029312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 307/623] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:11.030308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:11.134623 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6252-e19e-4a28-a98b-3fa88ce38956 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.159025 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc38867-3a85-40a2-8fe7-93a91ef35add None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.162348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:11.171529 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:11.172313 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:11.172721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:11.173095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] PATH_INFO: `/v3/users/glance` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:11.182078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:11.183654 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:11.196194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:11.197615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 317/624] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:11.203626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:11.205630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:11.206364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:11.206758 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:11.207105 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:11.208000 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=7605bd73b8204acba28a144a64d5eee7) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:11.208388 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:11.209943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:11.211789 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:11.217574 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 308/625] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:11 2022] GET /identity/v3/role_assignments?user.id=7605bd73b8204acba28a144a64d5eee7&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:11.218320 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:11.351140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95b628-0c15-41bb-b452-3b2c19f09e11 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.358030 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010f471-46aa-4384-b93d-ba1e6a80b40f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.401156 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:11.401986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:11.402375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:11.402724 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:11.403703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:11.403854 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:11.404423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:11.404708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:11.404881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:11.404993 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:11.405788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:11.406091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:11.406590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:11.407513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:11.428276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 318/626] 10.222.0.71 () {56 vars in 1139 bytes} [Wed Jul 27 19:10:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:11.433664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:11.435805 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 309/627] 10.222.0.71 () {56 vars in 1137 bytes} [Wed Jul 27 19:10:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:11.441537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:11.473973 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:11.517245 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:11.559554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b10a3-49fe-4404-b686-ec9b81ce3a32 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.566557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68e907-2514-4280-a212-28a8b9a7766d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.599656 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:11.600386 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:11.600801 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:11.601084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:11.610783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:11.611551 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:11.611840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:11.612116 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:11.687806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:11.689306 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:11.709682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:11.709682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:11.722055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:11.784209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:11.811786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 310/628] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 19:10:11.821671 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:11.842092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 319/629] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 19:10:11.843015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:11.942120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b28516-adcd-4c27-ab8c-18c697d9fa33 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.965416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afda44-ab0f-4a77-8d37-10790dbbf80b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:11.973005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:11.986317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:11.987186 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:11.987609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:11.988023 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.003148 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.004227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.004877 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.005160 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.005407 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.005542 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.016873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.018234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:12.024683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:12.025871 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:12.026953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:12.026953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:12.026953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:12.026953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:12.028889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 311/630] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:12.034917 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:12.041024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:12.041944 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:12.042833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:12.042833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:12.042833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:12.042833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:12.043729 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 320/631] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:12.049494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.071975 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:12.179900 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de2f9-19a7-4a8f-8a4b-f4a65b30948f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.185781 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47318348-5ba1-42e2-b35c-cf34832d9f8f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.223617 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.224141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.224419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.224690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.225368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:12.225685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.226193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.227625 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.227896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.228318 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.228802 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.229698 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:12.230197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.231726 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.245262 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 312/632] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:12.247646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.251887 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 321/633] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:12.257512 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.291224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:12.338921 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:12.358762 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c55c8-b05a-4e99-b65a-55bb4bbcc416 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.364760 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25c5e9-4d47-49cd-b2f5-235d2a88791d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.394781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.395432 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.395708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.395977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.403438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.403744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.404552 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.405035 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.405222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.405883 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.413192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.415449 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:12.418190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:12.419086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:12.419995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:12.424289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 313/634] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:12.425123 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:12.431497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:12.432382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:12.433292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:12.440324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 322/635] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:12.441445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.533600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:12.539189 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be1622-bcc4-4745-9e06-27074342db1b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.552842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ac663-84ab-4fe8-abac-2f7818b62d47 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.576443 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.577114 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.577394 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.577739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.578527 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:12.578788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.580274 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.592876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.593854 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.594354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.594839 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.595786 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:12.596305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.597853 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 314/636] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:12.598185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.600237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.601639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:12.618232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 323/637] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:12.619913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.715178 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668667f-3d84-4fd1-9bff-6c9adb4f19fb None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.732156 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526f62-6afb-4d70-a32e-b56c45bc33a7 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.755837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc4525-24f0-4f10-8154-0de151b5f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.756505 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc4525-24f0-4f10-8154-0de151b5f43b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.756786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc4525-24f0-4f10-8154-0de151b5f43b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.757058 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc4525-24f0-4f10-8154-0de151b5f43b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.758447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc4525-24f0-4f10-8154-0de151b5f43b None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=0421ec636a1545329ad46308ef451145) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:12.758809 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc4525-24f0-4f10-8154-0de151b5f43b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.760240 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc4525-24f0-4f10-8154-0de151b5f43b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.766720 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 315/638] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/role_assignments?user.id=0421ec636a1545329ad46308ef451145&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:12.778875 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58289-8371-4642-befe-4ad57f310c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.779916 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58289-8371-4642-befe-4ad57f310c16 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.780400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58289-8371-4642-befe-4ad57f310c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.780872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58289-8371-4642-befe-4ad57f310c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.781909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58289-8371-4642-befe-4ad57f310c16 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=d6d1644bffa94434900353bf4a2fecea) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:12.782462 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58289-8371-4642-befe-4ad57f310c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.784198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58289-8371-4642-befe-4ad57f310c16 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.792164 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 324/639] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/role_assignments?user.id=d6d1644bffa94434900353bf4a2fecea&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:13.200062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220df6-33fd-4c03-bdea-9c021983a83e None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.200448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220df6-33fd-4c03-bdea-9c021983a83e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.200649 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220df6-33fd-4c03-bdea-9c021983a83e None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.202179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 316/640] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:13.209291 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78139397-a388-4063-811a-f426951ff44a None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.209908 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78139397-a388-4063-811a-f426951ff44a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.210391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78139397-a388-4063-811a-f426951ff44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.235668 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-78139397-a388-4063-811a-f426951ff44a None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:13.237236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-78139397-a388-4063-811a-f426951ff44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:13.301724 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:13.314717 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 325/641] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:13.341858 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8220df6-33fd-4c03-bdea-9c021983a83e None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:13.370655 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:13.460420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8220df6-33fd-4c03-bdea-9c021983a83e None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:13.502509 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d12419-e4f3-4584-8b3d-c2381eb28305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:13.503159 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d12419-e4f3-4584-8b3d-c2381eb28305 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.503437 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d12419-e4f3-4584-8b3d-c2381eb28305 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.503709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d12419-e4f3-4584-8b3d-c2381eb28305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.514346 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d12419-e4f3-4584-8b3d-c2381eb28305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-a5d12419-e4f3-4584-8b3d-c2381eb28305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:13.521146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:13.522183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:13.523096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 317/642] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:13.530982 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78139397-a388-4063-811a-f426951ff44a None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:13.624987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307d470-6ce5-43b7-8272-f7ac0f54da24 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.625340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307d470-6ce5-43b7-8272-f7ac0f54da24 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.625540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307d470-6ce5-43b7-8272-f7ac0f54da24 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.627021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 318/643] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:13.632817 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5aba-766e-4e7b-8b6a-6ebc0866e164 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.633492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5aba-766e-4e7b-8b6a-6ebc0866e164 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.634020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5aba-766e-4e7b-8b6a-6ebc0866e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.640122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78139397-a388-4063-811a-f426951ff44a None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:13.656885 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-21da5aba-766e-4e7b-8b6a-6ebc0866e164 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:13.658466 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-21da5aba-766e-4e7b-8b6a-6ebc0866e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:13.684779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:13.684779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.684779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.684779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.685204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:13.685204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:13.686242 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:13.701810 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 326/644] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:13.704693 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:13.765764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 319/645] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:10:13.777370 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:13.782539 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5aba-766e-4e7b-8b6a-6ebc0866e164 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:13.797442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:13.830089 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240b66-fd25-46cd-a6da-e23608eec1c5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:13.866602 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:13.867787 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.868323 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.868594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.879817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:13.881252 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:13.894221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5aba-766e-4e7b-8b6a-6ebc0866e164 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:13.896204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:13.897053 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:13.898379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:13.898379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:13.898379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:13.898379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:13.902457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 327/646] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:13.903311 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:13.935666 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:13.936716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:13.937227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:13.937761 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:13.938597 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:13.940290 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:13.951814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:13.952850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:13.953731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:13.961206 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 320/647] 10.222.0.71 () {56 vars in 1129 bytes} [Wed Jul 27 19:10:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:13.962796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:14.011317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0fa6d-0068-4603-ba8a-93a96a77ffc3 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:14.013673 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:14.059893 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:14.060540 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:14.060823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:14.061100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:14.062686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:14.062993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:14.064614 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:14.066286 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:14.090426 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 328/648] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:14.092227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:14.103528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38a4f-426b-45b1-ac7e-97dbcc1ecb38 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:14.148491 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:14.149220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:14.149571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:14.149934 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:14.150689 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:14.151056 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:14.153052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:14.159689 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 321/649] 10.222.0.71 () {56 vars in 1124 bytes} [Wed Jul 27 19:10:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:14.165162 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:14.239587 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526a228-9f55-488d-9fc7-1484b6628d95 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:14.281626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25506c-3fe0-4941-9f4b-f0a76c8873d4 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:14.292221 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:14.293596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:14.294419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:14.294901 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:14.305523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:14.308041 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:14.317995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:14.318619 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:14.318899 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:14.319229 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:14.319902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:14.320281 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:14.321788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:14.325528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:14.326494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:14.327437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:14.334130 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 322/650] 10.222.0.71 () {56 vars in 1124 bytes} [Wed Jul 27 19:10:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:14.334569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 329/651] 10.222.0.71 () {56 vars in 1093 bytes} [Wed Jul 27 19:10:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:14.336373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:14.345343 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:14.458113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573df55-cfd1-45d8-9c23-e6c8246177e5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:14.498239 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:14.499195 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:14.499656 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:14.500145 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:14.501128 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:14.501593 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:14.503234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:14.523668 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 323/652] 10.222.0.71 () {56 vars in 1133 bytes} [Wed Jul 27 19:10:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:14.529555 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:14.558570 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:14.640955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968bc8-7fbe-4561-b0c4-db0a0847fac5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:14.677010 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:14.677640 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:14.677951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:14.678226 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:14.752039 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:14.753519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:14.779339 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:14.860762 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 330/653] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 19:10:14.866571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:14.936382 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:14.977821 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b8ebc-90c5-4b0b-ae7e-fe0097a5ca8a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.014649 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f035c1-39ad-4983-9329-337ab4114737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.015310 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f035c1-39ad-4983-9329-337ab4114737 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.015593 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f035c1-39ad-4983-9329-337ab4114737 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.015868 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f035c1-39ad-4983-9329-337ab4114737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.028587 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f035c1-39ad-4983-9329-337ab4114737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.030129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f035c1-39ad-4983-9329-337ab4114737 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-a1f035c1-39ad-4983-9329-337ab4114737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:15.047716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:15.048675 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:15.049876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:15.049876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:15.049876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:15.049876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:15.049876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 324/654] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:15.056855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.169673 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7be1d-7fbe-43aa-954c-d281580a23bb None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.190469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74735-9f3a-4f33-a5c1-9187a8b90f05 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.190775 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74735-9f3a-4f33-a5c1-9187a8b90f05 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.191032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74735-9f3a-4f33-a5c1-9187a8b90f05 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.193141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 325/655] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:15.198727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:15.199649 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd4b9-136b-4296-9196-acb87a222389 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.199912 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd4b9-136b-4296-9196-acb87a222389 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.200370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd4b9-136b-4296-9196-acb87a222389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.211778 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7a75-e9cf-4f0a-a8c9-aab9e9deee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.212413 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7a75-e9cf-4f0a-a8c9-aab9e9deee86 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.212693 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7a75-e9cf-4f0a-a8c9-aab9e9deee86 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.212968 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7a75-e9cf-4f0a-a8c9-aab9e9deee86 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.214210 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7a75-e9cf-4f0a-a8c9-aab9e9deee86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:15.214521 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7a75-e9cf-4f0a-a8c9-aab9e9deee86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.216193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7a75-e9cf-4f0a-a8c9-aab9e9deee86 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.219359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-45abd4b9-136b-4296-9196-acb87a222389 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:15.220824 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-45abd4b9-136b-4296-9196-acb87a222389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:15.230215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 331/656] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:15.231903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672d8f-ddd7-4518-8d0a-5191f0eb5d12 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.232194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672d8f-ddd7-4518-8d0a-5191f0eb5d12 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.232473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672d8f-ddd7-4518-8d0a-5191f0eb5d12 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.234482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 332/657] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:15.239465 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672d8f-ddd7-4518-8d0a-5191f0eb5d12 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.301429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 326/658] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:10:15.303132 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5e7eb-726f-4c61-8139-d76e97d727ec None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.303644 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5e7eb-726f-4c61-8139-d76e97d727ec None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.304115 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5e7eb-726f-4c61-8139-d76e97d727ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.327003 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-14d5e7eb-726f-4c61-8139-d76e97d727ec None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:15.328886 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-14d5e7eb-726f-4c61-8139-d76e97d727ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:15.359229 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672d8f-ddd7-4518-8d0a-5191f0eb5d12 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.374676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:15.398194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.398825 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.399103 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.399590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.404148 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 327/659] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:15.404795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5e7eb-726f-4c61-8139-d76e97d727ec None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.418214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.420308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:15.434939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:15.435876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:15.436777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:15.438632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 333/660] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:15.439568 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.492705 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:15.517894 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5e7eb-726f-4c61-8139-d76e97d727ec None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.555118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.555774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.556069 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.556214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a8584-35f4-4670-9d66-cbb18944fd57 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.556406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] PATH_INFO: `/v3/services/network` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.556957 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.558447 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:15.567526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:15.568696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:15.569697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 328/661] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:15.570890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.593786 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.594429 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.594709 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.594979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] PATH_INFO: `/v3/services/image` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.595620 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.597356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:15.610092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:15.611155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:15.612013 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:15.616116 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 334/662] 10.222.0.71 () {56 vars in 1105 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:15.617580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.621323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:15.691865 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977632e-0580-4a1e-b5f2-76baa830cb15 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.728856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.729797 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.730265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.730694 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.731579 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:15.732084 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.733717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.745430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f24ad-d2df-47e1-be07-9c843df4b422 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.748399 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 329/663] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:15.749032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.760843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:15.791415 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.792044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.792794 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.793081 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.793798 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] RBAC: Adding query filter params (name=network) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:15.794119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.796172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.806175 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 335/664] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:15.806175 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.859768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:15.865380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6dfad-ce43-4e49-af32-6201eafd8616 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.903825 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.904476 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.904713 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.904986 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.905684 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] RBAC: Adding query filter params (name=image) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:15.905984 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.907546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.912157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 330/665] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:15.912933 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:15.925288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32382e26-8ac7-480b-be56-3f7ab7d0b733 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:15.965259 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:15.965841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:15.966137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:15.966396 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:15.967176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=059d420dbd794b8badd367bdb41ee2d6) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:15.967484 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:15.968897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:15.974881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 336/666] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/role_assignments?user.id=059d420dbd794b8badd367bdb41ee2d6&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=40fb60241dc645059f308de1b41e6e44 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:15.979318 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:16.030747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef47a4-ddcf-4985-beec-7c2511fbffce None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:16.033458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:16.086624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc34c0-8d7e-4b27-83c2-3c6a31b5862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:16.088235 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc34c0-8d7e-4b27-83c2-3c6a31b5862a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:16.088771 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc34c0-8d7e-4b27-83c2-3c6a31b5862a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:16.089697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc34c0-8d7e-4b27-83c2-3c6a31b5862a None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:16.090880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc34c0-8d7e-4b27-83c2-3c6a31b5862a None admin] RBAC: Adding query filter params (type=network) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:16.091371 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc34c0-8d7e-4b27-83c2-3c6a31b5862a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:16.093778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc34c0-8d7e-4b27-83c2-3c6a31b5862a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:16.110026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 331/667] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:16.116008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dbd0c-fe30-4f17-8f29-465b01b9a0be None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:16.161021 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11346-819a-4f17-b331-f0b88bd4c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:16.161687 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11346-819a-4f17-b331-f0b88bd4c671 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:16.161977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11346-819a-4f17-b331-f0b88bd4c671 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:16.162252 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11346-819a-4f17-b331-f0b88bd4c671 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:16.162943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11346-819a-4f17-b331-f0b88bd4c671 None admin] RBAC: Adding query filter params (type=image) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:16.163249 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11346-819a-4f17-b331-f0b88bd4c671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:16.165416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11346-819a-4f17-b331-f0b88bd4c671 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:16.172742 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 337/668] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:16.716487 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40069-7e98-4bf6-b6ea-3e9f499619a4 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:16.716901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40069-7e98-4bf6-b6ea-3e9f499619a4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:16.717102 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40069-7e98-4bf6-b6ea-3e9f499619a4 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:16.718761 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 332/669] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:16.724178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6df31-3567-402a-a0a9-db286ee120af None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:16.724710 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6df31-3567-402a-a0a9-db286ee120af None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:16.725218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6df31-3567-402a-a0a9-db286ee120af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:16.745621 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-76a6df31-3567-402a-a0a9-db286ee120af None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:16.747589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-76a6df31-3567-402a-a0a9-db286ee120af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:16.819790 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 338/670] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:16.843333 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40069-7e98-4bf6-b6ea-3e9f499619a4 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:16.873676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:16.958410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40069-7e98-4bf6-b6ea-3e9f499619a4 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:16.994992 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdc481-bf93-4422-b770-8179cbfaeb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:16.995532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdc481-bf93-4422-b770-8179cbfaeb74 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:16.995838 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdc481-bf93-4422-b770-8179cbfaeb74 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:16.996085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdc481-bf93-4422-b770-8179cbfaeb74 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:16.996778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdc481-bf93-4422-b770-8179cbfaeb74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:16.998176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdc481-bf93-4422-b770-8179cbfaeb74 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:17.016601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 333/671] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:10:16 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:18.361410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913a7b-34de-4d7f-ad67-0992a9e8d64b None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.363057 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913a7b-34de-4d7f-ad67-0992a9e8d64b None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.363885 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913a7b-34de-4d7f-ad67-0992a9e8d64b None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.368270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 339/672] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:18.373712 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821652-542e-4346-98ae-675097742b5f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.374538 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821652-542e-4346-98ae-675097742b5f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.374538 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821652-542e-4346-98ae-675097742b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.395312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-47821652-542e-4346-98ae-675097742b5f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:18.396539 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-47821652-542e-4346-98ae-675097742b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:18.456412 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe6ee-bcd0-4224-bf16-e1cdbf075163 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.456750 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe6ee-bcd0-4224-bf16-e1cdbf075163 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.456976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe6ee-bcd0-4224-bf16-e1cdbf075163 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.458634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 340/673] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:18.463951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f96d0-3958-4d94-9790-b841854ddcf6 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.464261 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f96d0-3958-4d94-9790-b841854ddcf6 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.464542 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f96d0-3958-4d94-9790-b841854ddcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.477312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 334/674] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:10:18.484908 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-2a8f96d0-3958-4d94-9790-b841854ddcf6 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:18.486146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-2a8f96d0-3958-4d94-9790-b841854ddcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:18.505198 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821652-542e-4346-98ae-675097742b5f None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:18.517186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:18.523643 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:18.565666 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 341/675] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 19:10:18.567733 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e770-d210-47d1-bfe3-52058168886d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.568261 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e770-d210-47d1-bfe3-52058168886d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.568669 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e770-d210-47d1-bfe3-52058168886d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.571438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 342/676] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:18.576549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159222-7990-4400-8575-4c661eaa6c0a None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.576904 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159222-7990-4400-8575-4c661eaa6c0a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.577252 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159222-7990-4400-8575-4c661eaa6c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.598703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-fa159222-7990-4400-8575-4c661eaa6c0a None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:18.599881 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-fa159222-7990-4400-8575-4c661eaa6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:18.629635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821652-542e-4346-98ae-675097742b5f None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:18.674205 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:18.674865 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.675149 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.675485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.677408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 343/677] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 19:10:18.678265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159222-7990-4400-8575-4c661eaa6c0a None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:18.699385 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:18.705904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:18.706862 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:10:18.707691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:18.710051 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 335/678] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:18.711682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:18.788009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:18.788983 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:18.799462 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159222-7990-4400-8575-4c661eaa6c0a None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:18.824751 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4d80-a9c5-4ad4-94cb-d0710ad348c3 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:18.837574 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:18.838244 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.838579 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.838859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.839552 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:18.840920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:18.857072 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 344/679] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:10:18 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:18.858145 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:18.879969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:18.881075 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.881515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.882982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.884536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:18.886906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:18.914911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 336/680] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:10:18 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:19.013242 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd284-eeae-44ae-a331-b14a7347e453 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:19.071936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:19.072999 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.073489 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.074026 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.075017 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:19.075559 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:19.077204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:19.088224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 345/681] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:19.093673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.214434 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902033e-4cab-43d6-bd74-c45959b8c379 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:19.242384 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:19.253347 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987cc3-91d8-414e-ac72-607a8275626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:19.254050 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987cc3-91d8-414e-ac72-607a8275626a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.254331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987cc3-91d8-414e-ac72-607a8275626a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.254602 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987cc3-91d8-414e-ac72-607a8275626a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.266410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987cc3-91d8-414e-ac72-607a8275626a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:19.267931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987cc3-91d8-414e-ac72-607a8275626a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-31987cc3-91d8-414e-ac72-607a8275626a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:19.284546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:19.285822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:19.287014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:19.287014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:19.287014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:19.287014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:19.287014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 337/682] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:19.294179 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.305783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:19.345000 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a199-f0f0-4334-85d8-c71e883bc6e3 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.345536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a199-f0f0-4334-85d8-c71e883bc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.345765 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a199-f0f0-4334-85d8-c71e883bc6e3 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.347310 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 338/683] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:10:19.354105 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316000f6-010f-4624-a435-f92147e42e59 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.354383 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316000f6-010f-4624-a435-f92147e42e59 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.354651 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316000f6-010f-4624-a435-f92147e42e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.374126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-316000f6-010f-4624-a435-f92147e42e59 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:19.375337 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-316000f6-010f-4624-a435-f92147e42e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:19.421140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0482da-706f-4dce-a07d-49cd8afcbd3d None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:19.461787 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 339/684] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:19.464624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:19.465200 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.465483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.465810 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.466543 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:19.466823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:19.468182 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:19.480535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 346/685] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:19.484108 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316000f6-010f-4624-a435-f92147e42e59 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.485836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.575415 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:19.609836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316000f6-010f-4624-a435-f92147e42e59 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:19.610969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7e2b-18d3-42da-8d5c-1a1a8752c81b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:19.624275 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:19.648385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:19.649426 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.649955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.650427 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.654731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:19.655390 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.655673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.655952 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.656584 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:19.657977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:19.659884 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:19.661659 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:19.667709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:19.668685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:19.669525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:19.673953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 340/686] 10.222.0.71 () {56 vars in 1129 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:19.674969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:19.678598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:19.680403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:19.681347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:19.687721 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 347/687] 10.222.0.71 () {56 vars in 1093 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:19.689265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.791263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400125d-a7b3-4826-8207-74a94e089ff5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:19.803697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc46ec8-4361-43a1-b196-59b5871c97d0 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:19.828697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082f928-75e4-4637-8266-367a85253959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:19.829333 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082f928-75e4-4637-8266-367a85253959 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.829618 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082f928-75e4-4637-8266-367a85253959 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.829967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082f928-75e4-4637-8266-367a85253959 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.830883 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082f928-75e4-4637-8266-367a85253959 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:19.831209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082f928-75e4-4637-8266-367a85253959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:19.832786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082f928-75e4-4637-8266-367a85253959 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:19.835764 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:19.844450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 341/688] 10.222.0.71 () {56 vars in 1124 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:19.845921 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082f928-75e4-4637-8266-367a85253959 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.849080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:19.850910 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:19.851626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:19.852212 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:19.853248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:19.853833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:19.855945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:19.886735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 348/689] 10.222.0.71 () {56 vars in 1133 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:19.891854 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:19.898698 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:19.966258 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082f928-75e4-4637-8266-367a85253959 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.001467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4a4ce-88dd-4c37-9429-f83c15093d0f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.010390 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.011388 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.011388 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.011668 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.012324 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:20.012630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.014269 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.024293 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 342/690] 10.222.0.71 () {56 vars in 1124 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:20.025627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:20.041901 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.043005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.043534 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.044074 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.056499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.058523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:20.075636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:20.076609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:20.077491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:20.077491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:20.077491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:20.077491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:20.084201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 349/691] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:20.086024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:20.131239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:20.140183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8cbac-4e57-485c-95a3-974982a169af None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.142151 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:20.182255 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.182984 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.183350 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.183622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.184384 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] RBAC: Adding query filter params (interface=public, service_id=43e806ca3ca84b218aeba990e6172ee4, region_id=RegionOne) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:20.184742 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.186201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.200026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 343/692] 10.222.0.71 () {56 vars in 1251 bytes} [Wed Jul 27 19:10:20 2022] GET /identity/v3/endpoints?service_id=43e806ca3ca84b218aeba990e6172ee4&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:20.201127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:20.205796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d1c9-1339-499f-a2b9-b4b5c5448533 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.252077 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.252629 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.252909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.253247 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.253985 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:20.254342 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.256201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.275181 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 350/693] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:20.280445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:20.330839 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2f06d-6f6f-48ae-9f56-2f25689252f8 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.367176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.368166 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.368446 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.368717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.369367 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.371568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.381930 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 344/694] 10.222.0.71 () {56 vars in 1087 bytes} [Wed Jul 27 19:10:20 2022] GET /identity/v3/services => generated 1002 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:10:20.403933 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:20.409029 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08300d4-c4dc-4d2e-959f-40c8dc5a4a12 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.448548 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74153-0860-4948-8907-d512c50091ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.450036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74153-0860-4948-8907-d512c50091ae None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.450561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74153-0860-4948-8907-d512c50091ae None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.451036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74153-0860-4948-8907-d512c50091ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.459133 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d74153-0860-4948-8907-d512c50091ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.461892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d74153-0860-4948-8907-d512c50091ae None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-20d74153-0860-4948-8907-d512c50091ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:20.474606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:20.475569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:20.477138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:20.480107 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 351/695] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:20.486783 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:20.527772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:20.606830 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79139-e602-4c46-b7ef-a25805b6fb21 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.643657 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1847fd-8b33-46dd-936f-bccf07c1ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.644283 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1847fd-8b33-46dd-936f-bccf07c1ea11 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.644558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1847fd-8b33-46dd-936f-bccf07c1ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.644832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1847fd-8b33-46dd-936f-bccf07c1ea11 None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.645695 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1847fd-8b33-46dd-936f-bccf07c1ea11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:20.645992 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1847fd-8b33-46dd-936f-bccf07c1ea11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.647416 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1847fd-8b33-46dd-936f-bccf07c1ea11 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.661243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 345/696] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:20.667980 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74153-0860-4948-8907-d512c50091ae None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:20.776533 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74153-0860-4948-8907-d512c50091ae None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:20.812879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9e83c-5401-405b-9766-473567438365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:20.813488 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9e83c-5401-405b-9766-473567438365 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:20.813798 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9e83c-5401-405b-9766-473567438365 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:20.814205 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9e83c-5401-405b-9766-473567438365 None admin] PATH_INFO: `/v3/projects/074f3318a4b34aac85f631b95f159c12/users/059d420dbd794b8badd367bdb41ee2d6/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:20.816174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9e83c-5401-405b-9766-473567438365 None admin] RBAC: Authorizing `identity:create_grant(project_id=074f3318a4b34aac85f631b95f159c12, user_id=059d420dbd794b8badd367bdb41ee2d6, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:20.817593 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9e83c-5401-405b-9766-473567438365 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:20.833367 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 352/697] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:10:20 2022] PUT /identity/v3/projects/074f3318a4b34aac85f631b95f159c12/users/059d420dbd794b8badd367bdb41ee2d6/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:10:21.299323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4d6e-6f48-48e9-a1cd-fc7346599d06 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.300085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4d6e-6f48-48e9-a1cd-fc7346599d06 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.300563 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4d6e-6f48-48e9-a1cd-fc7346599d06 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.302423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 346/698] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:21.308597 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148e05e-049e-44a6-a951-7246382c9d91 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.309135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148e05e-049e-44a6-a951-7246382c9d91 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.309627 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148e05e-049e-44a6-a951-7246382c9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.330068 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-f148e05e-049e-44a6-a951-7246382c9d91 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:21.331265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-f148e05e-049e-44a6-a951-7246382c9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:21.345692 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:21.352528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078a06-0d17-483b-9104-f078b246e66e None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.352803 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078a06-0d17-483b-9104-f078b246e66e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.353082 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078a06-0d17-483b-9104-f078b246e66e None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.354819 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 347/699] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:21.360039 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02637c5-220c-4867-8030-89648380c7e1 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.360327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02637c5-220c-4867-8030-89648380c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.360602 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02637c5-220c-4867-8030-89648380c7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.379309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e02637c5-220c-4867-8030-89648380c7e1 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:21.380498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e02637c5-220c-4867-8030-89648380c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:21.415069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 353/700] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:21.442596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148e05e-049e-44a6-a951-7246382c9d91 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.475731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 348/701] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 19:10:21.499507 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02637c5-220c-4867-8030-89648380c7e1 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.522719 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:21.559505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148e05e-049e-44a6-a951-7246382c9d91 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:21.595244 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:21.595989 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.596315 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.596593 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] PATH_INFO: `/v3/services/network` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.597217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:21.598701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:21.608827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:21.609880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:21.611390 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:21.612141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02637c5-220c-4867-8030-89648380c7e1 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:21.615031 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 354/702] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:21.616113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.633444 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:21.648860 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:21.649568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.649887 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.650165 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] PATH_INFO: `/v3/services/image` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.650808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:21.652218 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:21.662256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:21.664481 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:21.665907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:21.670520 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 349/703] 10.222.0.71 () {56 vars in 1105 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:21.670520 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.725687 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c40fd-e2f0-4c6e-93cf-37c5f75155ed None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:21.762294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:21.762917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.763192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.763464 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.764416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] RBAC: Adding query filter params (name=network) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:21.764416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:21.765859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:21.775451 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:21.776556 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 355/704] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:21.777521 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.794914 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8e553-8232-4fdc-8549-4a6e6be826ec None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:21.829462 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:21.830470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.830987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.831540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.832417 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] RBAC: Adding query filter params (name=image) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:21.832903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:21.834594 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:21.840458 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 350/705] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:21.847257 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.868959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:21.901165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aefa0-6097-4225-bf64-9e3c5a7aa44b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:21.945635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:21.946497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.947036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.947548 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.948951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] RBAC: Adding query filter params (type=network) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:21.949631 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:21.951970 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:21.962144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 356/706] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:21.966113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.977724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b444b3-c1f9-4a16-96bb-f556e552cadc None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:22.027298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:22.028405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:22.028696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:22.028979 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:22.029958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] RBAC: Adding query filter params (type=image) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:22.030278 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:22.031932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:22.043607 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 351/707] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:22.045426 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:22.068484 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:22.097785 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb0c13-5e93-4cd4-9ef1-69c5944d8e33 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:22.139004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:22.140002 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:22.140578 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:22.141069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:22.142126 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] RBAC: Adding query filter params (interface=public, service_id=36559047f1ee4911b2b4a9d61270e846, region_id=RegionOne) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:22.142651 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:22.144312 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:22.157888 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 357/708] 10.222.0.71 () {56 vars in 1251 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/endpoints?service_id=36559047f1ee4911b2b4a9d61270e846&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:22.159449 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:22.165027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:22.186155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2b7f9-c1cc-4de9-94f0-b6fee47fd643 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:22.232779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:22.233410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:22.233722 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:22.234254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:22.235410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] RBAC: Adding query filter params (interface=public, service_id=18bee39b69c14fc9b8999cbab2155fa5, region_id=RegionOne) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:22.235734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:22.237380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:22.245466 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 352/709] 10.222.0.71 () {56 vars in 1251 bytes} [Wed Jul 27 19:10:22 2022] GET /identity/v3/endpoints?service_id=18bee39b69c14fc9b8999cbab2155fa5&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:22.249839 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:22.283798 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a7589-d97e-4ac3-8b9b-49cdf268e0f0 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:22.334071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2ee2-5568-460d-aa3c-91e318c8897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:22.335105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2ee2-5568-460d-aa3c-91e318c8897b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:22.336724 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2ee2-5568-460d-aa3c-91e318c8897b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:22.337208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2ee2-5568-460d-aa3c-91e318c8897b None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:22.338099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2ee2-5568-460d-aa3c-91e318c8897b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:22.339675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2ee2-5568-460d-aa3c-91e318c8897b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:22.346049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 358/710] 10.222.0.71 () {56 vars in 1087 bytes} [Wed Jul 27 19:10:22 2022] GET /identity/v3/services => generated 1002 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:10:22.363863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:22.392102 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce7d3-7f12-4a4a-ab98-a51399c68607 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:22.433155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157ee3-4805-4d81-bf1a-c27df02a561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:22.434264 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157ee3-4805-4d81-bf1a-c27df02a561d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:22.434753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157ee3-4805-4d81-bf1a-c27df02a561d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:22.435232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157ee3-4805-4d81-bf1a-c27df02a561d None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:22.436112 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157ee3-4805-4d81-bf1a-c27df02a561d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:22.437738 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157ee3-4805-4d81-bf1a-c27df02a561d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:22.444485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 353/711] 10.222.0.71 () {56 vars in 1087 bytes} [Wed Jul 27 19:10:22 2022] GET /identity/v3/services => generated 1002 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:10:22.787105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfbfc3-2966-40e7-9d2b-d3f69ba64eb1 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:22.787659 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfbfc3-2966-40e7-9d2b-d3f69ba64eb1 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:22.787741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfbfc3-2966-40e7-9d2b-d3f69ba64eb1 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:22.789581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 359/712] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:22.795004 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97021ddb-333b-456d-9d9f-29edab2e66e4 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:22.795467 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97021ddb-333b-456d-9d9f-29edab2e66e4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:22.795574 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97021ddb-333b-456d-9d9f-29edab2e66e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:22.815321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-97021ddb-333b-456d-9d9f-29edab2e66e4 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:22.816539 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-97021ddb-333b-456d-9d9f-29edab2e66e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:22.892853 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 354/713] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:22.916929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfbfc3-2966-40e7-9d2b-d3f69ba64eb1 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:22.995575 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:23.033693 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfbfc3-2966-40e7-9d2b-d3f69ba64eb1 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:23.073492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339970cc-edd4-4446-9c9e-fda2bdbc5eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:23.074200 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339970cc-edd4-4446-9c9e-fda2bdbc5eba None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.074479 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339970cc-edd4-4446-9c9e-fda2bdbc5eba None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.074749 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339970cc-edd4-4446-9c9e-fda2bdbc5eba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.075391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339970cc-edd4-4446-9c9e-fda2bdbc5eba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:23.076786 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339970cc-edd4-4446-9c9e-fda2bdbc5eba None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-339970cc-edd4-4446-9c9e-fda2bdbc5eba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:23.087459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:23.088452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:23.089483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 360/714] 10.222.0.71 () {56 vars in 1129 bytes} [Wed Jul 27 19:10:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:23.096809 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97021ddb-333b-456d-9d9f-29edab2e66e4 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:23.173757 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:23.207400 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97021ddb-333b-456d-9d9f-29edab2e66e4 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:23.231124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bd7f7-ef2a-4352-8cf2-3e8ec579d01a None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.231435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bd7f7-ef2a-4352-8cf2-3e8ec579d01a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.231677 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bd7f7-ef2a-4352-8cf2-3e8ec579d01a None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.234117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 361/715] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:23.239203 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc8862-605e-4be1-8856-4d8c911e71a0 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.239492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc8862-605e-4be1-8856-4d8c911e71a0 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.239870 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc8862-605e-4be1-8856-4d8c911e71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.246756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:23.247323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.247609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.248061 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.249593 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:23.249937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:23.251317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:23.257321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 355/716] 10.222.0.71 () {56 vars in 1124 bytes} [Wed Jul 27 19:10:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:23.260344 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-e9cc8862-605e-4be1-8856-4d8c911e71a0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:23.261614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-e9cc8862-605e-4be1-8856-4d8c911e71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:23.262877 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:23.345710 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 362/717] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:23.373350 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc8862-605e-4be1-8856-4d8c911e71a0 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:23.385000 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3b499-dbf7-4beb-babb-014e9c44714f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:23.431180 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:23.431874 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.432231 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.432580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.433515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:23.433923 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:23.435388 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:23.436879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:23.443604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 356/718] 10.222.0.71 () {56 vars in 1124 bytes} [Wed Jul 27 19:10:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:23.453760 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:23.455986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:23.498490 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc8862-605e-4be1-8856-4d8c911e71a0 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:23.541122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:23.542316 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.542788 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.543270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.556304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:10:23.562185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:23.563260 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:10:23.564138 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:23.566765 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 363/719] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:23.573564 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:23.583829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966999e-f814-4179-b262-fc356587ec2f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:23.640196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:23.641517 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.642038 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.642829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.644239 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:23.646550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:23.679393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 357/720] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:10:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:10:23.705503 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894537-738a-4976-8a56-2249ed9d1fe5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:23.733380 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:23.753569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:23.754227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.754507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.754778 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.755553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:23.755852 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:23.757903 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:23.772165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 364/721] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:23.774289 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:23.838659 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:23.894601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1adc6-6026-4a04-910c-c6b2a0cd428c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:23.932657 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:23.933305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:23.933587 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:23.933932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:23.945269 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:23.946551 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:23.961664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:23.963709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:23.965816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:23.965816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:23.965816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:23.965816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:23.965816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 358/722] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:23.969063 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:24.075199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b66b2-b426-46d9-b746-5e3d0123a056 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:24.111055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:24.111684 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.111964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.112237 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.112931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:24.113232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:24.114618 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:24.133804 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 365/723] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:24.135810 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:24.250451 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac9f66-b161-4d45-b6ab-b01d7e0c1289 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:24.257870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:24.290230 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:24.290885 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.291162 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.291435 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.299794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:24.301249 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:24.313305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:24.315253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:24.316552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 359/724] 10.222.0.71 () {56 vars in 1093 bytes} [Wed Jul 27 19:10:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:24.320675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:24.374855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:24.436106 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282d1e-94c4-4091-b98b-29065f07e013 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:24.472274 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16f6a-d620-475a-98b8-43dd3ca85725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:24.472897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16f6a-d620-475a-98b8-43dd3ca85725 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.473170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16f6a-d620-475a-98b8-43dd3ca85725 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.473443 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16f6a-d620-475a-98b8-43dd3ca85725 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.474275 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16f6a-d620-475a-98b8-43dd3ca85725 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:24.474576 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16f6a-d620-475a-98b8-43dd3ca85725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:24.476104 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16f6a-d620-475a-98b8-43dd3ca85725 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:24.499227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 366/725] 10.222.0.71 () {56 vars in 1133 bytes} [Wed Jul 27 19:10:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:24.500561 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:24.612636 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c0ebd-3152-4c02-b63e-32a0c6141857 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:24.649996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594fd3a-36d8-4ab8-b570-ac65c9c9dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:24.650627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594fd3a-36d8-4ab8-b570-ac65c9c9dac5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.650903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594fd3a-36d8-4ab8-b570-ac65c9c9dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.651176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594fd3a-36d8-4ab8-b570-ac65c9c9dac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.694423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:24.747930 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594fd3a-36d8-4ab8-b570-ac65c9c9dac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:24.749693 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594fd3a-36d8-4ab8-b570-ac65c9c9dac5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:24.760758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785228f0-de5f-4c86-9007-5675bb778a3a None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.761072 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785228f0-de5f-4c86-9007-5675bb778a3a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.761314 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785228f0-de5f-4c86-9007-5675bb778a3a None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.763024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 367/726] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:24.768036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e540-37dd-4245-8216-39398d609bf0 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.768317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e540-37dd-4245-8216-39398d609bf0 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.768592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e540-37dd-4245-8216-39398d609bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.791025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-60b3e540-37dd-4245-8216-39398d609bf0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:24.792232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-60b3e540-37dd-4245-8216-39398d609bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:24.871898 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 360/727] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:10:24 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 19:10:24.877389 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 368/728] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:24 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:24.878043 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab507e3-2fbd-463b-996d-69f377246f01 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.878434 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab507e3-2fbd-463b-996d-69f377246f01 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.878710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab507e3-2fbd-463b-996d-69f377246f01 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.884829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 361/729] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:24.886614 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e540-37dd-4245-8216-39398d609bf0 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:24.886833 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033aefa-02b4-461f-a592-9a4f460679e1 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:24.887112 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033aefa-02b4-461f-a592-9a4f460679e1 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:24.887413 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033aefa-02b4-461f-a592-9a4f460679e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:24.906734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-9033aefa-02b4-461f-a592-9a4f460679e1 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:24.907880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-9033aefa-02b4-461f-a592-9a4f460679e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:24.920811 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:24.974579 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:24.984282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 362/730] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:24 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:24.985317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033aefa-02b4-461f-a592-9a4f460679e1 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.010869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e540-37dd-4245-8216-39398d609bf0 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.048554 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.049208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.049952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.050243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.062177 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.063630 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:25.080176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:25.081207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:25.082141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:25.082141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:25.082141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:25.082141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:25.082141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 369/731] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:25.082417 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.107024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033aefa-02b4-461f-a592-9a4f460679e1 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.149017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.149691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.149998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.150273 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] PATH_INFO: `/v3/services/image` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.150907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.152263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:25.161183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:25.162402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:25.163938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 363/732] 10.222.0.71 () {56 vars in 1105 bytes} [Wed Jul 27 19:10:24 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:25.164805 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.175612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:25.198236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7280d2c-6845-46f4-9ec9-4b106d121b35 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.232175 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:25.234377 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.235027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.235308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.235579 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] PATH_INFO: `/v3/services/network` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.236201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.237588 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:25.249480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:25.250734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:25.251577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 370/733] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:25.252453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.290250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1b635-a0c7-4e8e-addf-0ffcc8b99fe0 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.326256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.327157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.327440 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.327721 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.328542 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:25.328828 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.330359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.347532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 364/734] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:25.347532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.373416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d1fe-e274-4b2f-b232-0e6eac2d7923 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.409624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.410277 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.410559 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.410833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.411558 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] RBAC: Adding query filter params (name=image) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:25.411804 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.413169 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.424666 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 371/735] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:25.424666 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.436140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:25.462766 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac61aa-0688-49a5-b96d-a795fd68ea1d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.486978 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:25.505031 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.505364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.505660 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.505970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.506955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] RBAC: Adding query filter params (name=network) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:25.507131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.509157 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.519381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 365/736] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:25.519381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.541774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c8c7-26ba-4c6d-8e57-a6eac2077242 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.577889 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.578538 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.578816 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.579085 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.587161 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.588577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:25.600233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:25.601231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:25.602815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 372/737] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:25.603571 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.635174 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18acea-2960-41b1-8fbe-d2f803443af6 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.680008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:25.680561 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.681691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.681938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.682309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.682896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:25.683204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.685131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.691068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 366/738] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:25.691859 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.722573 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166a354-2e2a-422d-8269-871526d4e7e8 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.748642 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:25.765132 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.765876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.766255 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.766347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.766987 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] RBAC: Adding query filter params (type=network) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:25.767288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.768633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.778411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 373/739] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:25.778411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.813892 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0bdb-2f32-4a64-bd46-418ea83225d5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.851092 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.851715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.851994 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.852324 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.853042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:25.853042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.855277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.874717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 367/740] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:25.874717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:25.883450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade180a-eb64-491c-928f-0fd39e5bece4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:25.918484 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:25.925346 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:25.926005 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:25.926291 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:25.926565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:25.927283 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:25.928738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:25.952828 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 374/741] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:10:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:25.962772 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:26.018261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f650-0907-43c1-94a0-be6cc52eff1b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:26.033819 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:26.081896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62a713-86a7-4a7e-adde-f0e6c48297a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:26.082572 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a713-86a7-4a7e-adde-f0e6c48297a3 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:26.082865 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a713-86a7-4a7e-adde-f0e6c48297a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:26.083146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a713-86a7-4a7e-adde-f0e6c48297a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:26.083914 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62a713-86a7-4a7e-adde-f0e6c48297a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:26.085442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62a713-86a7-4a7e-adde-f0e6c48297a3 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:26.104675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a128a0-1e11-4452-8644-adc189ee2db2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:26.118604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 368/742] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:10:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:26.146391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832be89-5df6-4121-b4b3-185e72fabc4a None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:26.147111 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832be89-5df6-4121-b4b3-185e72fabc4a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:26.147493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832be89-5df6-4121-b4b3-185e72fabc4a None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:26.149889 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 369/743] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:10:26.155572 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fc35c-921b-4f4e-a87f-37f006ce2f55 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:26.155900 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fc35c-921b-4f4e-a87f-37f006ce2f55 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:26.156125 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fc35c-921b-4f4e-a87f-37f006ce2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:26.162090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:26.162727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:26.163011 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:26.163411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:26.164405 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=059d420dbd794b8badd367bdb41ee2d6) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:26.164718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:26.169876 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:26.182735 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 375/744] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:10:25 2022] GET /identity/v3/role_assignments?user.id=059d420dbd794b8badd367bdb41ee2d6&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=40fb60241dc645059f308de1b41e6e44 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:26.182977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-a49fc35c-921b-4f4e-a87f-37f006ce2f55 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:26.182977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a49fc35c-921b-4f4e-a87f-37f006ce2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:26.271895 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 370/745] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:26 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 19:10:26.295979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:26.358479 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:26.423532 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81eb39-d19d-42f8-8d0a-b0caf7ea0187 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:26.460591 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:26.461305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:26.461590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:26.461894 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:26.462517 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:26.463885 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:26.473195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:26.474463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:26.475332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 376/746] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:26.481061 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fc35c-921b-4f4e-a87f-37f006ce2f55 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:26.577185 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:26.590543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fc35c-921b-4f4e-a87f-37f006ce2f55 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:26.627011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9524b1-10e3-4f8b-8387-9b34b587a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:26.627639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9524b1-10e3-4f8b-8387-9b34b587a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:26.627925 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9524b1-10e3-4f8b-8387-9b34b587a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:26.628205 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9524b1-10e3-4f8b-8387-9b34b587a2e9 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:26.628883 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9524b1-10e3-4f8b-8387-9b34b587a2e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:26.629186 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9524b1-10e3-4f8b-8387-9b34b587a2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:26.630594 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9524b1-10e3-4f8b-8387-9b34b587a2e9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:26.640621 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 371/747] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:26.642214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:26.758152 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefaa3d-ee73-494a-9d41-6dbcdc627add None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:26.771331 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:26.795748 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd7992-c5fa-4523-af55-0c2b83b811cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:26.796379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7992-c5fa-4523-af55-0c2b83b811cf None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:26.796659 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7992-c5fa-4523-af55-0c2b83b811cf None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:26.796934 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7992-c5fa-4523-af55-0c2b83b811cf None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:26.797623 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd7992-c5fa-4523-af55-0c2b83b811cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:26.797972 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd7992-c5fa-4523-af55-0c2b83b811cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:26.799375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd7992-c5fa-4523-af55-0c2b83b811cf None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:26.806000 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 377/748] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:28.297566 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806d373-1e4a-415b-83ea-3cb5a65b4fb2 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.298148 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806d373-1e4a-415b-83ea-3cb5a65b4fb2 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.298148 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806d373-1e4a-415b-83ea-3cb5a65b4fb2 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.299747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 372/749] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:28.305296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc0523-2910-4bb1-94f2-ad56b91d7dcf None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.305831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc0523-2910-4bb1-94f2-ad56b91d7dcf None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.305919 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc0523-2910-4bb1-94f2-ad56b91d7dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.324547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-0abc0523-2910-4bb1-94f2-ad56b91d7dcf None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:28.326198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-0abc0523-2910-4bb1-94f2-ad56b91d7dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:28.409807 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 378/750] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:28 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:28.429124 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806d373-1e4a-415b-83ea-3cb5a65b4fb2 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:28.511308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9404aaa-384c-4a08-b003-65f4f60a1e75 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.511637 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9404aaa-384c-4a08-b003-65f4f60a1e75 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.511868 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9404aaa-384c-4a08-b003-65f4f60a1e75 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.513214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 379/751] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:10:28.518256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8879-4dde-4c9d-80d5-772ac60128fd None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.518766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8879-4dde-4c9d-80d5-772ac60128fd None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.519043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8879-4dde-4c9d-80d5-772ac60128fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.537792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-673a8879-4dde-4c9d-80d5-772ac60128fd None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:28.538832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806d373-1e4a-415b-83ea-3cb5a65b4fb2 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:28.539041 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-673a8879-4dde-4c9d-80d5-772ac60128fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:28.576419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:28.576969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.577250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.577531 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.602570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:28.613942 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 380/752] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:28 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 19:10:28.637024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a8879-4dde-4c9d-80d5-772ac60128fd None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:28.652392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:28.653881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:28.675470 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:28.753539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a8879-4dde-4c9d-80d5-772ac60128fd None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:28.770550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 373/753] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:10:28 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 19:10:28.776187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:28.793423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:28.794099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.794377 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.794643 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.795256 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:28.796599 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:28.806851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:28.807818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:28.808758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 381/754] 10.222.0.71 () {56 vars in 1132 bytes} [Wed Jul 27 19:10:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:28.814953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:28.838617 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:28.890274 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c08283-f136-4b42-a889-f7894cd76ab9 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:28.919917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:28.923265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81325-a1ea-481e-be6f-dcebcc6003c0 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:28.927126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:28.927767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.928043 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.928314 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.940128 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:28.941626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:10:28.958042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:28.959077 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:28.960126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:10:28.960126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:10:28.960126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:10:28.960126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:28.960126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 374/755] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:10:28.964178 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:28.964792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:28.965073 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:28.965350 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:28.965443 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:28.966095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:28.966401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:28.967812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:28.979921 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 382/756] 10.222.0.71 () {56 vars in 1126 bytes} [Wed Jul 27 19:10:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:28.980325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:29.077796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf19cdc-ffbe-46a3-92d2-67dec440c284 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:29.084584 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbea92-c6c0-4aad-879a-16c8e6ecc650 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:29.088717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:29.121442 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11748340-89a7-4897-ba66-c741fd550dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:29.121684 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:29.122094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:29.122220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11748340-89a7-4897-ba66-c741fd550dbe None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:29.122368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11748340-89a7-4897-ba66-c741fd550dbe None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:29.122463 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:29.122637 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:29.122728 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11748340-89a7-4897-ba66-c741fd550dbe None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:29.123304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11748340-89a7-4897-ba66-c741fd550dbe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:29.123406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:29.123603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11748340-89a7-4897-ba66-c741fd550dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:29.123696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:29.124949 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:29.125041 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11748340-89a7-4897-ba66-c741fd550dbe None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:29.129537 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 383/757] 10.222.0.71 () {56 vars in 1126 bytes} [Wed Jul 27 19:10:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:29.131201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86ebe-58ba-452e-8fed-33f5436322c8 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:29.131503 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86ebe-58ba-452e-8fed-33f5436322c8 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:29.132456 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86ebe-58ba-452e-8fed-33f5436322c8 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:29.134513 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 384/758] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:29.140419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8fed3-315e-430a-8e33-1284a9930ab0 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:29.140701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8fed3-315e-430a-8e33-1284a9930ab0 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:29.140983 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8fed3-315e-430a-8e33-1284a9930ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:29.148696 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 375/759] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:29.162918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-a1c8fed3-315e-430a-8e33-1284a9930ab0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:29.164541 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-a1c8fed3-315e-430a-8e33-1284a9930ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:29.193729 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:29.250483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 385/760] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:29 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 19:10:29.281443 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:29.396598 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159b0dd-a065-4678-89f8-c398654794a7 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:29.435391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f20580-b16d-4d1c-9ed4-7a20fbe593d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:29.436014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20580-b16d-4d1c-9ed4-7a20fbe593d2 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:29.436298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20580-b16d-4d1c-9ed4-7a20fbe593d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:29.436568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f20580-b16d-4d1c-9ed4-7a20fbe593d2 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:29.437254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f20580-b16d-4d1c-9ed4-7a20fbe593d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:29.438653 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f20580-b16d-4d1c-9ed4-7a20fbe593d2 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:29.455150 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 376/761] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:10:29 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:31.472727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09099e0-7d6d-4f67-82a9-d6680480978e None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.473371 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09099e0-7d6d-4f67-82a9-d6680480978e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.473371 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09099e0-7d6d-4f67-82a9-d6680480978e None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.474623 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 386/762] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:31.480292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea06ff-747c-49a0-a511-69797d5d08b6 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.480714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea06ff-747c-49a0-a511-69797d5d08b6 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.480842 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea06ff-747c-49a0-a511-69797d5d08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.499511 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-9eea06ff-747c-49a0-a511-69797d5d08b6 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:31.500682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-9eea06ff-747c-49a0-a511-69797d5d08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:31.521226 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:31.582728 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 377/763] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:31 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:31.606653 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09099e0-7d6d-4f67-82a9-d6680480978e None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:31.702147 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415923b5-1231-462e-862d-a616351b8d02 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.702444 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415923b5-1231-462e-862d-a616351b8d02 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.702726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415923b5-1231-462e-862d-a616351b8d02 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.704069 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 378/764] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:31.708951 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc149f8-6f27-4e45-bbf2-6b74d1c1ce15 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.709237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc149f8-6f27-4e45-bbf2-6b74d1c1ce15 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.709551 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc149f8-6f27-4e45-bbf2-6b74d1c1ce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.717011 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09099e0-7d6d-4f67-82a9-d6680480978e None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:31.727485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-7fc149f8-6f27-4e45-bbf2-6b74d1c1ce15 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:31.728607 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-7fc149f8-6f27-4e45-bbf2-6b74d1c1ce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:31.754519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:31.755063 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.755344 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.755616 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.756304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:31.758270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:31.772920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 387/765] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:10:31 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:31.807269 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 379/766] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:31 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 19:10:31.831808 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:31.852819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:31.962118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdff711-abea-4aec-b377-3afb6fb0086c None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:31.998113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:31.998688 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.998962 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.999234 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.999859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:32.001223 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:32.010304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:32.011454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:32.012353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 388/767] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:32.017618 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc149f8-6f27-4e45-bbf2-6b74d1c1ce15 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:32.100012 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:32.124590 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc149f8-6f27-4e45-bbf2-6b74d1c1ce15 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:32.161185 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:32.161845 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:32.162130 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:32.162401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:32.163707 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:32.164251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:32.165657 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:32.170995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 380/768] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:32.176742 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:32.270434 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:32.295584 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0692-fef3-4add-814d-55b984d7f6d3 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:32.328456 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:32.329074 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:32.329354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:32.329625 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:32.330318 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:32.330617 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:32.331970 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:32.337270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 389/769] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:32.343344 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:32.454469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43428593-7a00-41d5-b520-e9b3f298c9b3 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:32.489325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f492f33-6682-42ac-a67d-acc111e3f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:32.490022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492f33-6682-42ac-a67d-acc111e3f3ea None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:32.490234 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492f33-6682-42ac-a67d-acc111e3f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:32.490508 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492f33-6682-42ac-a67d-acc111e3f3ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:32.491861 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f492f33-6682-42ac-a67d-acc111e3f3ea None admin] RBAC: Adding query filter params (interface=public, service_id=e83c53a3b9da4ee6bdc63a7cba5e97bb, region_id=RegionOne) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:32.492247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f492f33-6682-42ac-a67d-acc111e3f3ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:32.493885 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f492f33-6682-42ac-a67d-acc111e3f3ea None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:32.499072 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 381/770] 10.222.0.71 () {56 vars in 1251 bytes} [Wed Jul 27 19:10:32 2022] GET /identity/v3/endpoints?service_id=e83c53a3b9da4ee6bdc63a7cba5e97bb&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:32.504611 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:32.611741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee16b75-c07b-4f6b-bc97-22e41a65c33c None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:32.647433 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615152ca-10ad-4d45-ba0a-4615b9a3d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:32.648460 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615152ca-10ad-4d45-ba0a-4615b9a3d849 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:32.648744 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615152ca-10ad-4d45-ba0a-4615b9a3d849 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:32.649021 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615152ca-10ad-4d45-ba0a-4615b9a3d849 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:32.649692 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615152ca-10ad-4d45-ba0a-4615b9a3d849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:32.651047 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615152ca-10ad-4d45-ba0a-4615b9a3d849 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:32.656898 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 390/771] 10.222.0.71 () {56 vars in 1087 bytes} [Wed Jul 27 19:10:32 2022] GET /identity/v3/services => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:10:34.135298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f57d6-0fb5-4312-aeba-e63ba40b3e0e None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:34.135848 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f57d6-0fb5-4312-aeba-e63ba40b3e0e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:34.135988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f57d6-0fb5-4312-aeba-e63ba40b3e0e None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:34.137856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 382/772] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:34.144655 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f384-e797-4859-8fd6-b8b9c56ab5ec None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:34.145159 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f384-e797-4859-8fd6-b8b9c56ab5ec None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:34.145279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f384-e797-4859-8fd6-b8b9c56ab5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:34.166036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-a879f384-e797-4859-8fd6-b8b9c56ab5ec None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:34.167250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-a879f384-e797-4859-8fd6-b8b9c56ab5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:34.171109 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:34.265709 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 391/773] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:34 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 19:10:34.291306 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f57d6-0fb5-4312-aeba-e63ba40b3e0e None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:34.301543 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:34.417868 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f57d6-0fb5-4312-aeba-e63ba40b3e0e None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:34.467522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:34.468181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:34.468460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:34.468733 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:34.469364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:34.470851 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:34.481998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:34.483036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:34.484565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 383/774] 10.222.0.71 () {56 vars in 1132 bytes} [Wed Jul 27 19:10:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:34.489498 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f384-e797-4859-8fd6-b8b9c56ab5ec None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:34.610713 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f384-e797-4859-8fd6-b8b9c56ab5ec None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:34.654499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:34.655385 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:34.655671 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:34.656874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:34.658505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:34.658776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:34.661085 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:34.672949 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 392/775] 10.222.0.71 () {56 vars in 1126 bytes} [Wed Jul 27 19:10:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:34.680652 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:34.781057 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:34.820964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35a2f0-5414-4dcc-aa82-0493489632c4 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:34.866815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:34.868127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:34.868409 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:34.868680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:34.869371 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:34.869692 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:34.871126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:34.878801 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 384/776] 10.222.0.71 () {56 vars in 1126 bytes} [Wed Jul 27 19:10:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:34.886857 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:34.892198 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:35.003553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175e5e6-4ac0-4a78-b66c-45c10a034220 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:35.037220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c166c5b-ace6-42ce-89b3-5d6ffbf3b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:35.038373 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166c5b-ace6-42ce-89b3-5d6ffbf3b06f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:35.038654 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166c5b-ace6-42ce-89b3-5d6ffbf3b06f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:35.038930 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166c5b-ace6-42ce-89b3-5d6ffbf3b06f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:35.039672 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c166c5b-ace6-42ce-89b3-5d6ffbf3b06f None admin] RBAC: Adding query filter params (interface=public, service_id=4f3b70b785354d12922774ba12545bb1, region_id=RegionOne) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:35.039982 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c166c5b-ace6-42ce-89b3-5d6ffbf3b06f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:35.041335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c166c5b-ace6-42ce-89b3-5d6ffbf3b06f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:35.046434 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 393/777] 10.222.0.71 () {56 vars in 1251 bytes} [Wed Jul 27 19:10:34 2022] GET /identity/v3/endpoints?service_id=4f3b70b785354d12922774ba12545bb1&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:35.052122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:35.152909 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d80638-de7f-4ab0-9d79-e3e5a054cb7d None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:35.191604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d861129-7e68-4ee8-b6ac-aad1368e8a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:35.192257 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861129-7e68-4ee8-b6ac-aad1368e8a01 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:35.192538 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861129-7e68-4ee8-b6ac-aad1368e8a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:35.192812 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861129-7e68-4ee8-b6ac-aad1368e8a01 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:35.193508 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d861129-7e68-4ee8-b6ac-aad1368e8a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:35.195003 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d861129-7e68-4ee8-b6ac-aad1368e8a01 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:35.196370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:35.203076 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 385/778] 10.222.0.71 () {56 vars in 1087 bytes} [Wed Jul 27 19:10:35 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:10:35.346837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cb789-7425-4548-b5a5-000560db5d17 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:35.347365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cb789-7425-4548-b5a5-000560db5d17 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:35.347365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cb789-7425-4548-b5a5-000560db5d17 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:35.348940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 394/779] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:35.355500 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa3ac-d995-4364-b2de-35f436c42d22 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:35.355792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa3ac-d995-4364-b2de-35f436c42d22 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:35.356126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa3ac-d995-4364-b2de-35f436c42d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:35.375910 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-2fbaa3ac-d995-4364-b2de-35f436c42d22 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:35.377135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-2fbaa3ac-d995-4364-b2de-35f436c42d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:35.448856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 386/780] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:35.473798 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cb789-7425-4548-b5a5-000560db5d17 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:35.545050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:35.579338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cb789-7425-4548-b5a5-000560db5d17 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:35.615291 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:35.615906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:35.616340 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:35.616624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:35.617250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:35.618904 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:35.627727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:35.628952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:35.629853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 395/781] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:35.636246 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaa3ac-d995-4364-b2de-35f436c42d22 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:35.739778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaa3ac-d995-4364-b2de-35f436c42d22 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:35.766233 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:35.776235 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:35.776863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:35.777141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:35.777413 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:35.778115 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:35.778416 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:35.779764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:35.785303 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 387/782] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:10:35.790907 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:35.892653 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385499b-61df-48a2-b448-1594ed0af41f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:35.923262 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:35.929016 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41703-89e9-462b-b551-d387c6218154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:35.929669 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41703-89e9-462b-b551-d387c6218154 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:35.929943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41703-89e9-462b-b551-d387c6218154 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:35.930217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41703-89e9-462b-b551-d387c6218154 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:35.930892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41703-89e9-462b-b551-d387c6218154 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:35.931197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41703-89e9-462b-b551-d387c6218154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:35.932550 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41703-89e9-462b-b551-d387c6218154 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:35.937516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 396/783] 10.222.0.71 () {56 vars in 1114 bytes} [Wed Jul 27 19:10:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:35.943185 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:36.050721 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce439e-e970-43c4-a09f-382cfaba1801 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:36.084906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e226918-6a68-4ce3-832c-dbc8aeedfdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:36.085680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e226918-6a68-4ce3-832c-dbc8aeedfdb1 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:36.085962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e226918-6a68-4ce3-832c-dbc8aeedfdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:36.086233 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e226918-6a68-4ce3-832c-dbc8aeedfdb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:36.086952 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e226918-6a68-4ce3-832c-dbc8aeedfdb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:36.088304 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e226918-6a68-4ce3-832c-dbc8aeedfdb1 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:36.114744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 388/784] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:10:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:37.626895 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a5db7-c535-4701-8b30-2053a0a4c223 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:37.627443 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a5db7-c535-4701-8b30-2053a0a4c223 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:37.627443 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a5db7-c535-4701-8b30-2053a0a4c223 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:37.628841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 397/785] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:37.635780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32c637-428a-487b-b01e-f845f4563346 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:37.636268 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32c637-428a-487b-b01e-f845f4563346 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:37.636555 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32c637-428a-487b-b01e-f845f4563346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:37.654670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-5c32c637-428a-487b-b01e-f845f4563346 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:37.655875 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-5c32c637-428a-487b-b01e-f845f4563346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:37.707227 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:37.742117 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 389/786] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:37 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:37.767177 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a5db7-c535-4701-8b30-2053a0a4c223 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:37.878651 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a5db7-c535-4701-8b30-2053a0a4c223 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:37.914647 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:37.915286 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:37.915562 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:37.915828 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:37.916445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:37.917830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:37.927635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:37.930197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:37.931139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 398/787] 10.222.0.71 () {56 vars in 1132 bytes} [Wed Jul 27 19:10:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:37.938451 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32c637-428a-487b-b01e-f845f4563346 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:38.048656 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32c637-428a-487b-b01e-f845f4563346 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:38.088971 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:38.089606 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:38.090153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:38.090646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:38.091532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:38.091843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:38.093221 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:38.099072 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 390/788] 10.222.0.71 () {56 vars in 1126 bytes} [Wed Jul 27 19:10:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:38.105961 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:38.170084 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:38.215882 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854be7-19d8-4e59-a72c-10ca9715eb98 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:38.254886 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a26bd-e1f3-477f-bc0a-ef97bc4d2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:38.255515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a26bd-e1f3-477f-bc0a-ef97bc4d2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:38.255905 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a26bd-e1f3-477f-bc0a-ef97bc4d2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:38.256062 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a26bd-e1f3-477f-bc0a-ef97bc4d2eb5 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:38.256945 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a26bd-e1f3-477f-bc0a-ef97bc4d2eb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:38.257246 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a26bd-e1f3-477f-bc0a-ef97bc4d2eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:38.258651 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a26bd-e1f3-477f-bc0a-ef97bc4d2eb5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:38.263743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 399/789] 10.222.0.71 () {56 vars in 1126 bytes} [Wed Jul 27 19:10:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:38.270491 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:38.314479 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:38.382894 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f9c4d-e545-4bcb-868e-8f5542cf9842 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:38.426193 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e136f9-d394-489d-9938-67a76e727ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:38.426942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e136f9-d394-489d-9938-67a76e727ac2 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:38.427366 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e136f9-d394-489d-9938-67a76e727ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:38.427813 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e136f9-d394-489d-9938-67a76e727ac2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:38.428778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e136f9-d394-489d-9938-67a76e727ac2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:38.430206 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e136f9-d394-489d-9938-67a76e727ac2 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:38.467798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 391/790] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:10:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:38.540590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35bab-a502-4dea-aee8-3d4581d13c9e None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:38.540873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35bab-a502-4dea-aee8-3d4581d13c9e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:38.541145 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35bab-a502-4dea-aee8-3d4581d13c9e None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:38.542537 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 400/791] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:38.548370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bc35-3970-4c2a-847c-eff114f8b1d3 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:38.548662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bc35-3970-4c2a-847c-eff114f8b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:38.548935 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bc35-3970-4c2a-847c-eff114f8b1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:38.568211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-d076bc35-3970-4c2a-847c-eff114f8b1d3 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:38.569923 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-d076bc35-3970-4c2a-847c-eff114f8b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:38.659048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 392/792] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:38.684184 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35bab-a502-4dea-aee8-3d4581d13c9e None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:38.801940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35bab-a502-4dea-aee8-3d4581d13c9e None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:38.830442 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:38.843411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:38.844034 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:38.844321 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:38.844589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:38.845301 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:38.846746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:38.849402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING keystone.server.flask.common [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 19:10:38.875270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.sql.core [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 19:10:38.875270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 19:10:38.875270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [parameters: {'id': 'a0d033fefa124cab99b3e1ce5b331367', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 19:10:38.875270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87166) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0d033fefa124cab99b3e1ce5b331367.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0d033fefa124cab99b3e1ce5b331367. Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application conn.query(q) Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 19:10:38.892634 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result.read() Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 19:10:38.893734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application next(self.gen) Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application yield resource Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application next(self.gen) Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise self.value Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application session.commit() Jul 27 19:10:38.895239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.session.flush() Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application compat.raise_( Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 19:10:38.896475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 19:10:38.897719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application conn.query(q) Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result.read() Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 19:10:38.899149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [parameters: {'id': 'a0d033fefa124cab99b3e1ce5b331367', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:38.900248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:38.904792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0d033fefa124cab99b3e1ce5b331367. Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:38.905953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 401/793] 10.222.0.71 () {60 vars in 1140 bytes} [Wed Jul 27 19:10:38 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:38.906877 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076bc35-3970-4c2a-847c-eff114f8b1d3 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:38.935887 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:39.029988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076bc35-3970-4c2a-847c-eff114f8b1d3 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:39.069750 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58501a6-a9f1-49ab-aa5e-38ab7c24b8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:39.070385 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58501a6-a9f1-49ab-aa5e-38ab7c24b8a6 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:39.070663 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58501a6-a9f1-49ab-aa5e-38ab7c24b8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:39.070936 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58501a6-a9f1-49ab-aa5e-38ab7c24b8a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:39.078426 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58501a6-a9f1-49ab-aa5e-38ab7c24b8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:39.079865 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58501a6-a9f1-49ab-aa5e-38ab7c24b8a6 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-b58501a6-a9f1-49ab-aa5e-38ab7c24b8a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:10:39.092471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:39.093575 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:39.094662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 393/794] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:39.099939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:39.210758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4bde1-24f1-4c4f-b493-fe157f5090ad None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:39.248171 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5990841-1946-4be8-acf5-07170368c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:39.248797 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990841-1946-4be8-acf5-07170368c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:39.249079 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990841-1946-4be8-acf5-07170368c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:39.249351 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990841-1946-4be8-acf5-07170368c3b0 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:39.250112 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5990841-1946-4be8-acf5-07170368c3b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:39.250417 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5990841-1946-4be8-acf5-07170368c3b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:39.252200 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5990841-1946-4be8-acf5-07170368c3b0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:39.274636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 402/795] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:40.840283 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6f43-1ef9-4deb-87e3-7db6fbb275ed None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:40.840806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6f43-1ef9-4deb-87e3-7db6fbb275ed None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:40.840892 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6f43-1ef9-4deb-87e3-7db6fbb275ed None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:40.842237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 394/796] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:40.847598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb52e5-e28b-40c3-bb6f-56509a1ef377 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:40.848002 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb52e5-e28b-40c3-bb6f-56509a1ef377 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:40.848270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb52e5-e28b-40c3-bb6f-56509a1ef377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:40.867359 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-92cb52e5-e28b-40c3-bb6f-56509a1ef377 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:40.869095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-92cb52e5-e28b-40c3-bb6f-56509a1ef377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:40.903313 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:40.937869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 403/797] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:40 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:40.961136 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c6f43-1ef9-4deb-87e3-7db6fbb275ed None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:41.041220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:41.061502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c6f43-1ef9-4deb-87e3-7db6fbb275ed None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:41.093836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:41.094479 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:41.094754 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:41.095026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:41.095643 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:41.097001 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:41.106558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:41.108131 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:41.110037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:41.112576 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 395/798] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:41.113816 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb52e5-e28b-40c3-bb6f-56509a1ef377 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:41.214843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb52e5-e28b-40c3-bb6f-56509a1ef377 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:41.247540 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc852-bf6d-4d97-a6d2-729c98c330fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:41.248156 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc852-bf6d-4d97-a6d2-729c98c330fe None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:41.248431 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc852-bf6d-4d97-a6d2-729c98c330fe None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:41.248699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc852-bf6d-4d97-a6d2-729c98c330fe None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:41.249366 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc852-bf6d-4d97-a6d2-729c98c330fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:41.249684 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc852-bf6d-4d97-a6d2-729c98c330fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:41.251034 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc852-bf6d-4d97-a6d2-729c98c330fe None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:41.255803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 404/799] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:41.263013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:41.367354 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51ee2b-b25f-4fae-9499-2fa75a6c6661 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:41.400818 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1347307-9943-4d50-8159-091d3170e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:41.401428 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347307-9943-4d50-8159-091d3170e37e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:41.401744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347307-9943-4d50-8159-091d3170e37e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:41.402017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347307-9943-4d50-8159-091d3170e37e None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:41.402679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1347307-9943-4d50-8159-091d3170e37e None admin] RBAC: Adding query filter params (type=compute) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:41.402977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1347307-9943-4d50-8159-091d3170e37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:41.404324 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1347307-9943-4d50-8159-091d3170e37e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:41.408796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 396/800] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:41.619373 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0fa62-0af8-4647-acec-8360b8472ed8 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:41.619705 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0fa62-0af8-4647-acec-8360b8472ed8 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:41.619968 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0fa62-0af8-4647-acec-8360b8472ed8 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:41.621327 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 405/801] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:41.627601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb971eb-aa06-4bca-afc1-85fff75a1498 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:41.627977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb971eb-aa06-4bca-afc1-85fff75a1498 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:41.628319 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb971eb-aa06-4bca-afc1-85fff75a1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:41.647130 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-8cb971eb-aa06-4bca-afc1-85fff75a1498 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:41.648312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-8cb971eb-aa06-4bca-afc1-85fff75a1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:41.650334 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:41.717196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 397/802] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:41.743891 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0fa62-0af8-4647-acec-8360b8472ed8 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:41.778588 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:41.846754 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0fa62-0af8-4647-acec-8360b8472ed8 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:41.884771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:41.885398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:41.885608 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:41.885872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:41.886545 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:41.887964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:41.903483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.sql.core [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 19:10:41.903483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 19:10:41.903483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [parameters: {'user_id': 'fe9faa9d7a32475b8d98cb2944157085', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 19:10:41.903483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87166) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application conn.query(q) Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result.read() Jul 27 19:10:41.910337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 19:10:41.911430 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application next(self.gen) Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application yield resource Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application next(self.gen) Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise self.value Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application session.commit() Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 19:10:41.913088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.session.flush() Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application compat.raise_( Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 19:10:41.914118 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 19:10:41.914992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application conn.query(q) Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application result.read() Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 19:10:41.915830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fe9faa9d7a32475b8d98cb2944157085', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:41.916683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 19:10:41.917467 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 19:10:41.918670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 19:10:41.918670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 19:10:41.918670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 19:10:41.918670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 19:10:41.918670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 19:10:41.918670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:41.918670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 406/803] 10.222.0.71 () {60 vars in 1131 bytes} [Wed Jul 27 19:10:41 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:41.919261 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb971eb-aa06-4bca-afc1-85fff75a1498 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:42.029604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb971eb-aa06-4bca-afc1-85fff75a1498 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:42.064140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eebfd4-8646-4172-a6e0-24cbe0f502cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:42.064770 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eebfd4-8646-4172-a6e0-24cbe0f502cf None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:42.065048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eebfd4-8646-4172-a6e0-24cbe0f502cf None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:42.065316 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eebfd4-8646-4172-a6e0-24cbe0f502cf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:42.072233 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eebfd4-8646-4172-a6e0-24cbe0f502cf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:42.073754 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eebfd4-8646-4172-a6e0-24cbe0f502cf None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:42.075464 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-08eebfd4-8646-4172-a6e0-24cbe0f502cf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:10:42.087091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:42.088329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:42.089700 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 398/804] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:10:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:42.094333 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:42.193168 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:42.200410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d323e0d-6492-4e77-a5c4-c919b5a052b8 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:42.235978 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38455af1-a750-46f9-a327-d5ebfe6f48cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:42.236595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455af1-a750-46f9-a327-d5ebfe6f48cf None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:42.236874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455af1-a750-46f9-a327-d5ebfe6f48cf None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:42.237144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455af1-a750-46f9-a327-d5ebfe6f48cf None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:42.237925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38455af1-a750-46f9-a327-d5ebfe6f48cf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:42.238225 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38455af1-a750-46f9-a327-d5ebfe6f48cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:42.239823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38455af1-a750-46f9-a327-d5ebfe6f48cf None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:42.277384 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 407/805] 10.222.0.71 () {56 vars in 1101 bytes} [Wed Jul 27 19:10:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:43.670045 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11138-a275-4dfc-81a2-33bcc09be17b None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:43.670600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11138-a275-4dfc-81a2-33bcc09be17b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:43.670600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11138-a275-4dfc-81a2-33bcc09be17b None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:43.671918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 399/806] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:43.677104 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b0eba-bfeb-4cfe-a4be-d61196e1431a None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:43.677517 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b0eba-bfeb-4cfe-a4be-d61196e1431a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:43.677687 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b0eba-bfeb-4cfe-a4be-d61196e1431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:43.697354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-4d0b0eba-bfeb-4cfe-a4be-d61196e1431a None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:43.698932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-4d0b0eba-bfeb-4cfe-a4be-d61196e1431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:43.770459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 408/807] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:43 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:43.794209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa11138-a275-4dfc-81a2-33bcc09be17b None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:43.896317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa11138-a275-4dfc-81a2-33bcc09be17b None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:43.929488 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086ab54-da28-4ebf-aab7-67024b65f877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:43.930067 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086ab54-da28-4ebf-aab7-67024b65f877 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:43.930348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086ab54-da28-4ebf-aab7-67024b65f877 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:43.930624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086ab54-da28-4ebf-aab7-67024b65f877 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:43.931300 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086ab54-da28-4ebf-aab7-67024b65f877 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:43.932658 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086ab54-da28-4ebf-aab7-67024b65f877 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:43.946896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 400/808] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:10:43 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:46.172354 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e12b3-2ae1-4431-b1ff-123cc47e9a4d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:46.172905 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e12b3-2ae1-4431-b1ff-123cc47e9a4d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:46.172905 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e12b3-2ae1-4431-b1ff-123cc47e9a4d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:46.174279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 409/809] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:46.179419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e632-9b19-4b00-8fa1-4a8d098e628d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:46.179814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e632-9b19-4b00-8fa1-4a8d098e628d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:46.179969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e632-9b19-4b00-8fa1-4a8d098e628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:46.198135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-6e46e632-9b19-4b00-8fa1-4a8d098e628d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:46.199319 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-6e46e632-9b19-4b00-8fa1-4a8d098e628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:46.252533 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:46.273836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 401/810] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:46 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:46.297262 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e12b3-2ae1-4431-b1ff-123cc47e9a4d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:46.381373 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:46.398880 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e12b3-2ae1-4431-b1ff-123cc47e9a4d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:46.432058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:46.432624 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:46.432905 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:46.433205 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:46.433855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:46.435214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:46.444523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:46.445694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:10:46.446940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 410/811] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:46.451697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46e632-9b19-4b00-8fa1-4a8d098e628d None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:46.547958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46e632-9b19-4b00-8fa1-4a8d098e628d None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:46.581524 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:46.582166 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:46.582450 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:46.582726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:46.583428 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:46.583731 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:46.585133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:46.589879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 402/812] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:46.595613 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:46.710432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1c9b0-c812-49a0-98ee-007545ba0062 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:46.744757 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:46.745381 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:46.745684 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:46.745964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:46.746630 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:46.746931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:46.748284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:46.753097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 411/813] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:46.759832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:46.808890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:46.859952 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7559-7ea7-472e-bc31-0d2470f06ca9 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:46.893020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74037f3e-e7cc-4a88-b719-66c065b76d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:46.893633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037f3e-e7cc-4a88-b719-66c065b76d97 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:46.893943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037f3e-e7cc-4a88-b719-66c065b76d97 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:46.894217 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037f3e-e7cc-4a88-b719-66c065b76d97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:46.894966 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74037f3e-e7cc-4a88-b719-66c065b76d97 None admin] RBAC: Adding query filter params (interface=public, service_id=0f760a77ea424fee9a5af9daa40d4a1e, region_id=RegionOne) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:46.895274 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74037f3e-e7cc-4a88-b719-66c065b76d97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:46.897220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74037f3e-e7cc-4a88-b719-66c065b76d97 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:46.902161 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 403/814] 10.222.0.71 () {56 vars in 1251 bytes} [Wed Jul 27 19:10:46 2022] GET /identity/v3/endpoints?service_id=0f760a77ea424fee9a5af9daa40d4a1e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:46.907901 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:46.924033 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:47.007577 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa5d5-dd75-43a6-a3e7-1c271c68fae4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:47.039744 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffdc0e-6927-4574-8b36-be663127882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:47.040342 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffdc0e-6927-4574-8b36-be663127882b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:47.040618 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffdc0e-6927-4574-8b36-be663127882b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:47.040888 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffdc0e-6927-4574-8b36-be663127882b None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:47.041516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffdc0e-6927-4574-8b36-be663127882b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:47.042888 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffdc0e-6927-4574-8b36-be663127882b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:47.048907 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 412/815] 10.222.0.71 () {56 vars in 1087 bytes} [Wed Jul 27 19:10:46 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:10:49.284699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5df64-d05d-43c1-bc0c-bf23111ada7d None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:49.285236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5df64-d05d-43c1-bc0c-bf23111ada7d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:49.285236 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5df64-d05d-43c1-bc0c-bf23111ada7d None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:49.286607 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 404/816] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:10:49.292201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be3c-36b8-4266-b663-a6cb046f63a7 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:49.292616 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be3c-36b8-4266-b663-a6cb046f63a7 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:49.292752 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be3c-36b8-4266-b663-a6cb046f63a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:49.310664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-05d8be3c-36b8-4266-b663-a6cb046f63a7 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:49.311829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-05d8be3c-36b8-4266-b663-a6cb046f63a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:49.377223 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 413/817] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:10:49 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:10:49.401606 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5df64-d05d-43c1-bc0c-bf23111ada7d None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:49.500623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5df64-d05d-43c1-bc0c-bf23111ada7d None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:49.514752 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:49.537577 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:49.538174 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:49.538453 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:49.538726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:49.539341 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:49.540699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:10:49.549377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:10:49.550571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:10:49.551685 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 405/818] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:10:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:10:49.557134 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8be3c-36b8-4266-b663-a6cb046f63a7 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:49.565147 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:49.656199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8be3c-36b8-4266-b663-a6cb046f63a7 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:49.691889 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:49.692509 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:49.692793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:49.693071 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:49.694368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:49.694665 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:49.696022 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:49.700782 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 414/819] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:49.706664 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:49.807126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ed1bc-c448-4781-99fa-3af898682492 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:49.840313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbb127-37f7-4c41-87a8-a864add5ac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:49.840930 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbb127-37f7-4c41-87a8-a864add5ac9e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:49.841212 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbb127-37f7-4c41-87a8-a864add5ac9e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:49.841486 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbb127-37f7-4c41-87a8-a864add5ac9e None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:49.842209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbb127-37f7-4c41-87a8-a864add5ac9e None admin] RBAC: Adding query filter params (type=compute) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:10:49.842513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbb127-37f7-4c41-87a8-a864add5ac9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:49.843876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbb127-37f7-4c41-87a8-a864add5ac9e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:49.848707 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 406/820] 10.222.0.71 () {56 vars in 1112 bytes} [Wed Jul 27 19:10:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:10:49.854953 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:49.927208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:49.958140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d664d-75f4-4e09-a40c-5b360742ed29 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:49.992911 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444ee95-489d-4a7e-a56d-b8accf549d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:49.993522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ee95-489d-4a7e-a56d-b8accf549d1f None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:49.993836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ee95-489d-4a7e-a56d-b8accf549d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:49.994108 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ee95-489d-4a7e-a56d-b8accf549d1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:49.994843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444ee95-489d-4a7e-a56d-b8accf549d1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:49.996192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444ee95-489d-4a7e-a56d-b8accf549d1f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:50.014955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 415/821] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:10:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:10:59.846186 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=80 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:00.010911 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:52.001579 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5847b9-5e7c-4cb3-87eb-1c9090566cf0 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:52.002177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5847b9-5e7c-4cb3-87eb-1c9090566cf0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:52.002177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5847b9-5e7c-4cb3-87eb-1c9090566cf0 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:52.004044 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 407/822] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:11:52.010082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc745-caf3-457f-b250-7be7b46e2e08 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:52.010751 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc745-caf3-457f-b250-7be7b46e2e08 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:52.010751 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc745-caf3-457f-b250-7be7b46e2e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:52.032333 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-9ffbc745-caf3-457f-b250-7be7b46e2e08 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:11:52.033673 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9ffbc745-caf3-457f-b250-7be7b46e2e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:11:52.121572 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 416/823] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:11:52 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:11:52.149676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5847b9-5e7c-4cb3-87eb-1c9090566cf0 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:52.283162 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5847b9-5e7c-4cb3-87eb-1c9090566cf0 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:52.324807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:52.325547 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:52.325815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:52.326213 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:52.339964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:52.341848 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:11:52.361518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:11:52.362918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:11:52.370094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:11:52.370094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:11:52.370094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:11:52.370094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:11:52.370094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 408/824] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:11:52.371596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc745-caf3-457f-b250-7be7b46e2e08 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:52.523843 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc745-caf3-457f-b250-7be7b46e2e08 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:52.558559 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:52.569590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258544f-070c-4967-8b8c-b6217c729052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:52.570290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258544f-070c-4967-8b8c-b6217c729052 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:52.570581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258544f-070c-4967-8b8c-b6217c729052 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:52.570835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258544f-070c-4967-8b8c-b6217c729052 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:52.571571 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258544f-070c-4967-8b8c-b6217c729052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:11:52.571837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258544f-070c-4967-8b8c-b6217c729052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:52.573258 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258544f-070c-4967-8b8c-b6217c729052 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:52.588023 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 417/825] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:11:52.594034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:52.659352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:52.723662 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0787a6e-bc5a-449f-8e95-f1d711611517 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:52.766946 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3688e-05b2-4035-9b6b-4827c5f2d5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:52.767673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3688e-05b2-4035-9b6b-4827c5f2d5e9 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:52.768015 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3688e-05b2-4035-9b6b-4827c5f2d5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:52.768294 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3688e-05b2-4035-9b6b-4827c5f2d5e9 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:52.769682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3688e-05b2-4035-9b6b-4827c5f2d5e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:52.771295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3688e-05b2-4035-9b6b-4827c5f2d5e9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:52.794578 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 409/826] 10.222.0.71 () {60 vars in 1132 bytes} [Wed Jul 27 19:11:52 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:11:55.343796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c35bf-e86f-4001-bbbc-e64a0f00ac50 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:55.344411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c35bf-e86f-4001-bbbc-e64a0f00ac50 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:55.344411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c35bf-e86f-4001-bbbc-e64a0f00ac50 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:55.345827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 418/827] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:11:55.352577 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5cfa6-16d2-467f-8791-8dbead9e5cf8 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:55.353204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5cfa6-16d2-467f-8791-8dbead9e5cf8 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:55.353409 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5cfa6-16d2-467f-8791-8dbead9e5cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:55.376677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-74d5cfa6-16d2-467f-8791-8dbead9e5cf8 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:11:55.377774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-74d5cfa6-16d2-467f-8791-8dbead9e5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:11:55.460215 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 410/828] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:11:55 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:11:55.487306 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c35bf-e86f-4001-bbbc-e64a0f00ac50 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:55.608917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c35bf-e86f-4001-bbbc-e64a0f00ac50 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:55.648269 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:55.648943 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:55.649227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:55.649504 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:55.666437 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:11:55.671165 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:11:55.678967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:11:55.683649 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 419/829] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:11:55.684506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5cfa6-16d2-467f-8791-8dbead9e5cf8 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:55.725964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:55.799674 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5cfa6-16d2-467f-8791-8dbead9e5cf8 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:55.840902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:55.841955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:55.841955 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:55.842232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:55.843114 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] RBAC: Adding query filter params (name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:11:55.843421 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:55.845021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:55.855090 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 411/830] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:11:55.861242 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:55.920305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:55.988616 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc7f42-81b5-446b-a201-6cf64c59fa65 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:56.026969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:56.027611 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:56.027887 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:56.028155 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:56.039598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:56.041018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:11:56.056102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:11:56.057232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:11:56.058172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:11:56.058172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:11:56.058172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:11:56.058172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:11:56.058172 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 420/831] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:11:56.065947 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:56.179263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:56.182630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f1002-809c-44cd-97b3-e1e5d4ece41c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:56.224619 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:56.225285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:56.225558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:56.225921 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:56.226714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:11:56.227104 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:56.228567 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:56.244212 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 412/832] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:11:56.250998 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:56.369848 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:56.373919 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b794fa-b5eb-4420-9fca-0f0dc8df041f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:56.412874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:56.413522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:56.413835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:56.414108 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:56.422441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:56.424064 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:11:56.436936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:11:56.438324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:11:56.439332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 421/833] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:11:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:11:56.445451 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:56.575399 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde479fc-3fcb-46b9-add9-ea858cc930ae None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:56.624818 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:56.625414 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:56.625752 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:56.626036 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:56.626902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:11:56.627215 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:56.629330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:56.649627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 413/834] 10.222.0.71 () {56 vars in 1143 bytes} [Wed Jul 27 19:11:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:11:56.655778 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:56.778404 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7b9d-12fe-4fe3-9727-295f7fe707f3 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:56.819674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:56.821218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:56.821218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:56.821218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:56.850796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:56.895196 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:56.896606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:57.004545 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 422/835] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:11:56 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 19:11:57.010332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:57.031515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:57.122377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f75fc4-60e0-4c5d-87e9-e0fedfe5b3e5 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:57.156786 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:57.157429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:57.157740 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:57.158010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:57.169312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:57.170992 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:11:57.186009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:11:57.187164 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:11:57.188068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:11:57.188068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:11:57.188068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:11:57.188068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:11:57.188068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 414/836] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:11:57.193240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:57.255863 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:57.306514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645b562-851a-470d-b17e-1420adc3ba11 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:57.341927 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:57.342541 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:57.342874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:57.343144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:57.344393 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:11:57.344778 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:57.346090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:57.360459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 423/837] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:11:57.367482 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:57.450295 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:57.487265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81990f7-bc60-4b18-908b-a65d016302cd None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:57.527795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:57.528359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:57.528644 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:57.528939 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:57.536524 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:57.538033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:11:57.549243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:11:57.551103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:11:57.552022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 415/838] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:11:57.557884 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:57.680004 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3db0-6f84-47fe-a752-1afe14cefb27 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:57.701523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:57.723961 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c499332-55c1-4da4-809f-dd213af2911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:57.724602 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499332-55c1-4da4-809f-dd213af2911e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:57.724882 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499332-55c1-4da4-809f-dd213af2911e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:57.725154 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499332-55c1-4da4-809f-dd213af2911e None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:57.725932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c499332-55c1-4da4-809f-dd213af2911e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:11:57.726297 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c499332-55c1-4da4-809f-dd213af2911e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:57.727641 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c499332-55c1-4da4-809f-dd213af2911e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:57.741536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 424/839] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:11:57.747856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:57.866526 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d497a-8d9b-4c0f-96c1-d44348d92791 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:57.903041 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:57.911246 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23972ecb-7242-46f8-952a-808c5fb3be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:57.911970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23972ecb-7242-46f8-952a-808c5fb3be25 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:57.912279 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23972ecb-7242-46f8-952a-808c5fb3be25 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:57.912591 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23972ecb-7242-46f8-952a-808c5fb3be25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:57.913586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23972ecb-7242-46f8-952a-808c5fb3be25 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=cf8e06cedc354cf9b5896752243693a9) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:11:57.914021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23972ecb-7242-46f8-952a-808c5fb3be25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:57.915695 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23972ecb-7242-46f8-952a-808c5fb3be25 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:57.922027 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 416/840] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:11:57 2022] GET /identity/v3/role_assignments?user.id=cf8e06cedc354cf9b5896752243693a9&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:00.280063 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97ee2-e3b7-44ec-bcdb-9191d0fe5552 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:00.280607 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97ee2-e3b7-44ec-bcdb-9191d0fe5552 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:00.280607 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97ee2-e3b7-44ec-bcdb-9191d0fe5552 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:00.282351 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 425/841] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:12:00.287967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67cd07-d944-4910-94e7-28eee4cc5e92 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:00.288540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67cd07-d944-4910-94e7-28eee4cc5e92 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:00.288540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67cd07-d944-4910-94e7-28eee4cc5e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:00.307099 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-9c67cd07-d944-4910-94e7-28eee4cc5e92 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:00.308394 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-9c67cd07-d944-4910-94e7-28eee4cc5e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:00.386884 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 417/842] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:00.411363 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97ee2-e3b7-44ec-bcdb-9191d0fe5552 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:00.523665 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97ee2-e3b7-44ec-bcdb-9191d0fe5552 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:00.562020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:00.562632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:00.562925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:00.563281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:00.577522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:12:00.584382 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:00.585557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:00.586956 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 426/843] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:12:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:00.592477 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67cd07-d944-4910-94e7-28eee4cc5e92 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:00.703743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67cd07-d944-4910-94e7-28eee4cc5e92 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:00.729726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:00.745495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:00.746300 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:00.746741 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:00.747042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:00.747757 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] RBAC: Adding query filter params (name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:00.748062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:00.749768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:00.760856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 418/844] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:00.766689 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:00.813859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:00.884694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9366-ea2d-4e11-b587-295e2a4a1d1f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:00.924391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:00.925587 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:00.925981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:00.926341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:00.937535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:00.939119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:00.956976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:00.958163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:00.959267 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:00.959267 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:00.959267 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:00.959267 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:00.959267 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 427/845] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:00.964190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:01.086319 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7437-efed-456b-9c2b-4e5fc13e333a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:01.124980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:01.125736 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:01.126087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:01.126428 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:01.127209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:01.127515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:01.129986 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:01.151337 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 419/846] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:01.152769 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:01.268192 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:01.280159 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44fc6-a969-4945-a061-f4b24cde36b5 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:01.320427 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:01.321080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:01.321360 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:01.321612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:01.329712 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:01.331327 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:12:01.344582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:01.345812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:01.347400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 428/847] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:01.352580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:01.414860 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:01.476682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cae4f-39e8-4f85-afa0-b94f818cd75f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:01.517796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:01.518577 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:01.519499 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:01.519766 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:01.520920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:01.521267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:01.522903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:01.543276 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 420/848] 10.222.0.71 () {56 vars in 1143 bytes} [Wed Jul 27 19:12:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:12:01.549250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:01.660237 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877d1dc-7a24-4371-93c3-b0a22faa15ae None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:01.699349 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:01.700394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:01.700847 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:01.701389 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:01.716220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:01.717685 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:01.733939 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:01.735127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:01.736270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:01.736270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:01.736270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:01.736270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:01.736270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 429/849] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:12:01.743987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:01.862933 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e731f3b-6943-4f54-9b0d-5f3c7c893f53 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:01.865515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:01.907860 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:01.908562 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:01.908880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:01.909265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:01.910851 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:01.911224 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:01.912683 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:01.926038 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 421/850] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:12:01.932206 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:01.935386 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:02.058592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd0c2a-19b9-4977-b8af-453127a09361 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:02.094060 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:02.094710 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:02.094990 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:02.095264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:02.102561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:02.103991 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:12:02.118105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:02.119300 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:02.120304 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:02.125761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 430/851] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:02.125927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:02.241314 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06def9c-fe1c-4527-a543-8eb93e99a972 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:02.281670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b67581-b663-4e7d-b0a5-cad661d01b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:02.282323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67581-b663-4e7d-b0a5-cad661d01b2e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:02.282631 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67581-b663-4e7d-b0a5-cad661d01b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:02.282880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67581-b663-4e7d-b0a5-cad661d01b2e None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:02.283627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b67581-b663-4e7d-b0a5-cad661d01b2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:02.283931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b67581-b663-4e7d-b0a5-cad661d01b2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:02.286008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b67581-b663-4e7d-b0a5-cad661d01b2e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:02.299865 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 422/852] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:12:02.306908 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:02.385473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:02.437279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c7ba3-16b5-46d8-bbe2-c2503ec4c2f6 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:02.476125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13867ddf-14bf-4dfa-a77a-95c6069e23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:02.476806 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867ddf-14bf-4dfa-a77a-95c6069e23f9 None admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:02.477090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867ddf-14bf-4dfa-a77a-95c6069e23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:02.477363 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867ddf-14bf-4dfa-a77a-95c6069e23f9 None admin] PATH_INFO: `/v3/projects/074f3318a4b34aac85f631b95f159c12/users/cf8e06cedc354cf9b5896752243693a9/roles/88c688e9f05a469ba708f1481876f10c` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:02.496286 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13867ddf-14bf-4dfa-a77a-95c6069e23f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=074f3318a4b34aac85f631b95f159c12, user_id=cf8e06cedc354cf9b5896752243693a9, role_id=88c688e9f05a469ba708f1481876f10c)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:02.497673 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13867ddf-14bf-4dfa-a77a-95c6069e23f9 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:02.511128 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 431/853] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:12:02 2022] PUT /identity/v3/projects/074f3318a4b34aac85f631b95f159c12/users/cf8e06cedc354cf9b5896752243693a9/roles/88c688e9f05a469ba708f1481876f10c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:12:04.926050 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdeb56-5302-40fa-b102-05c6addc8d89 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:04.926661 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdeb56-5302-40fa-b102-05c6addc8d89 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:04.926661 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdeb56-5302-40fa-b102-05c6addc8d89 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:04.927930 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 423/854] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:04.933292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb0de-e7bb-4edc-9f59-d0c5600d0821 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:04.933743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb0de-e7bb-4edc-9f59-d0c5600d0821 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:04.933915 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb0de-e7bb-4edc-9f59-d0c5600d0821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:04.954146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-6c2fb0de-e7bb-4edc-9f59-d0c5600d0821 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:04.955404 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-6c2fb0de-e7bb-4edc-9f59-d0c5600d0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:05.030628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 432/855] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:04 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 19:12:05.060354 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdeb56-5302-40fa-b102-05c6addc8d89 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:05.091328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:05.191883 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdeb56-5302-40fa-b102-05c6addc8d89 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:05.231979 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:05.232635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:05.232931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:05.233185 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:05.245223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:12:05.250747 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:05.252194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:05.254263 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 424/856] 10.222.0.71 () {56 vars in 1102 bytes} [Wed Jul 27 19:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:05.259928 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fb0de-e7bb-4edc-9f59-d0c5600d0821 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:05.311025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:05.375250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fb0de-e7bb-4edc-9f59-d0c5600d0821 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:05.415501 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:05.416152 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:05.416434 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:05.416702 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:05.417408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] RBAC: Adding query filter params (name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:05.417744 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:05.419097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:05.428043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 433/857] 10.222.0.71 () {56 vars in 1103 bytes} [Wed Jul 27 19:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:05.433845 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:05.530377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:05.549251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e1221-deb2-4423-8a7e-39ff216e37e3 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:05.589150 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:05.589959 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:05.590312 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:05.590722 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:05.603418 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:05.605142 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:05.623623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:05.625022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:05.626332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:05.626332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:05.626332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:05.626332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:05.631382 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 425/858] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:05.632500 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:05.749810 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205dde-4259-4d2f-8b5e-434da8051b15 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:05.752675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:05.789504 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:05.790176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:05.790527 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:05.790879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:05.791659 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:05.791980 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:05.793587 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:05.807829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 434/859] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:12:05.814319 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:05.927541 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3801b-4622-4781-88e2-389001518c20 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:05.966269 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:05.966915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:05.967195 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:05.967471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:05.970172 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:05.976834 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:05.978710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:12:05.991010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:05.992210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:05.993612 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 426/860] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 19:12:05.999175 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:06.114146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae27f8-fde2-4571-b6f1-2e0229194d2f None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:06.150012 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:06.150683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:06.150989 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:06.151295 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:06.152213 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:06.152595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:06.154035 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:06.172670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 435/861] 10.222.0.71 () {56 vars in 1143 bytes} [Wed Jul 27 19:12:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:06.179965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:06.299758 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba8c3-2bd9-480b-bbed-3749dc2b8e91 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:06.338739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:06.339459 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:06.339763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:06.340039 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:06.429492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:06.433755 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:06.435184 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:06.552601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 427/862] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:12:06 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 19:12:06.559188 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:06.588789 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:06.690082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925ccd-ea4b-411e-851d-8f467cf53c86 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:06.732979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:06.733747 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:06.734091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:06.734432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:06.747016 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:06.748457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:06.765549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:06.766835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:06.775135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:06.775135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:06.775135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:06.775135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:06.775135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 436/863] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:06.775486 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:06.884089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:06.891775 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b749570-db81-4da2-aa6f-e766e42b45c9 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:06.930030 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:06.930732 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:06.931011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:06.931226 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:06.932003 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:06.932348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:06.933756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:06.950029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 428/864] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:12:06.953078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:07.035508 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:07.068703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a493b7-c803-4327-90a7-5e5d80123b8b None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:07.110607 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:07.111470 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:07.111750 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:07.112044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:07.121278 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:07.122739 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:12:07.135292 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:07.137125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:07.139003 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 437/865] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:07.143091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:07.260600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a94ac-610f-45c8-92cc-5c179bf0db66 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:07.305534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afca9fb-af3a-44ff-8e51-38741f50d86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:07.306317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca9fb-af3a-44ff-8e51-38741f50d86d None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:07.306605 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca9fb-af3a-44ff-8e51-38741f50d86d None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:07.306881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca9fb-af3a-44ff-8e51-38741f50d86d None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:07.307780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afca9fb-af3a-44ff-8e51-38741f50d86d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:07.308163 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afca9fb-af3a-44ff-8e51-38741f50d86d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:07.309790 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afca9fb-af3a-44ff-8e51-38741f50d86d None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:07.325108 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 429/866] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:12:07.331996 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:07.462202 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826070-ebdf-4b08-8122-32a8026af48a None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:07.500543 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30429-e5aa-4267-a326-a5f137827c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:07.501174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30429-e5aa-4267-a326-a5f137827c23 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:07.501450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30429-e5aa-4267-a326-a5f137827c23 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:07.501766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30429-e5aa-4267-a326-a5f137827c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:07.502547 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30429-e5aa-4267-a326-a5f137827c23 None admin] RBAC: Adding query filter params (role.id=88c688e9f05a469ba708f1481876f10c, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=cf8e06cedc354cf9b5896752243693a9) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:07.502855 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30429-e5aa-4267-a326-a5f137827c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:07.505538 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30429-e5aa-4267-a326-a5f137827c23 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:07.507477 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:07.513707 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 438/867] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:12:07 2022] GET /identity/v3/role_assignments?user.id=cf8e06cedc354cf9b5896752243693a9&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=88c688e9f05a469ba708f1481876f10c => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:09.942089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6dc5e-7fc3-4ea2-99f9-b9689f268c73 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:09.942780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6dc5e-7fc3-4ea2-99f9-b9689f268c73 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:09.942780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6dc5e-7fc3-4ea2-99f9-b9689f268c73 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:09.944205 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 430/868] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:09.950183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96977-ef1b-4936-93a4-56522d38071f None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:09.950652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96977-ef1b-4936-93a4-56522d38071f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:09.950892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96977-ef1b-4936-93a4-56522d38071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:09.969608 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-d5e96977-ef1b-4936-93a4-56522d38071f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:09.970834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-d5e96977-ef1b-4936-93a4-56522d38071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:10.045280 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 439/869] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:09 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:10.071296 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6dc5e-7fc3-4ea2-99f9-b9689f268c73 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:10.092536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:10.185807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6dc5e-7fc3-4ea2-99f9-b9689f268c73 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:10.224006 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:10.224667 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:10.224950 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:10.225230 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:10.237351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:12:10.242315 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:10.243781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:10.244673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 431/870] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:12:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:10.250229 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e96977-ef1b-4936-93a4-56522d38071f None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:10.369506 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e96977-ef1b-4936-93a4-56522d38071f None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:10.404705 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:10.414940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:10.415635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:10.415883 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:10.416131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:10.416831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:10.417139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:10.418531 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:10.427968 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 440/871] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:12:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:10.434018 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:10.517858 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:10.543563 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4d53-8fb8-479b-951c-5fff197da34f None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:10.583455 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:10.584120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:10.584405 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:10.584680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:10.598817 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:10.601204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:10.620792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:10.621931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:10.622962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:10.622962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:10.622962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:10.622962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:10.622962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 432/872] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:10.627964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:10.763907 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446c028-f158-4873-b4c7-36564f999598 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:10.800572 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:10.801435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:10.801829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:10.802121 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:10.803063 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:10.803355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:10.804957 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:10.819984 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 441/873] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:10.826010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:10.938223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6874a-2132-4356-990f-5a0b58979050 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:10.967379 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:10.976120 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:10.976772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:10.977039 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:10.977313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:10.985939 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:10.988403 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:12:11.002646 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:11.003937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:11.004896 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 433/874] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:11.010336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:11.068418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:11.125902 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bf310-1ff4-4307-b243-1d2f4d1a6912 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:11.166418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:11.167133 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:11.167480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:11.167830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:11.168900 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:11.169416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:11.171294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:11.198025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 442/875] 10.222.0.71 () {56 vars in 1143 bytes} [Wed Jul 27 19:12:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:11.199515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:11.314529 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74718894-fd77-4b19-beb4-a93e6350d43c None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:11.365270 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:11.366125 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:11.366533 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:11.366879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:11.441483 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:11.455536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:11.457513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:11.564610 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 434/876] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:12:11 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 19:12:11.570967 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:11.691251 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99e96-757d-4232-8871-5e3e26b38c37 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:11.701733 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:11.732247 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:11.732824 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:11.733107 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:11.733379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:11.745535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:11.747025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:11.763293 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:11.764411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:11.765480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:11.765480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:11.765480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:11.765480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:11.765480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 443/877] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:11.771475 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:11.860842 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:11.874018 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b44fc-9377-471b-8150-f909c0fa1b19 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:11.910914 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:11.911547 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:11.911835 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:11.912103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:11.912796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:11.913091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:11.914493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:11.927175 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 435/878] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:11.933135 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:12.049085 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422269-d9cb-4fe7-a416-c00c428e2605 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:12.083010 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:12.083642 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:12.083920 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:12.084193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:12.090663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:12.092099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:12:12.103294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:12.104338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:12.105394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 444/879] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:12.110361 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:12.209624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc4dd-c820-40d3-84cf-4fbee1d252dd None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:12.241908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dcfe4-b582-4f31-b194-5da911d0b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:12.242516 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcfe4-b582-4f31-b194-5da911d0b7ff None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:12.243052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcfe4-b582-4f31-b194-5da911d0b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:12.243326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dcfe4-b582-4f31-b194-5da911d0b7ff None admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:12.244111 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dcfe4-b582-4f31-b194-5da911d0b7ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:12.244411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dcfe4-b582-4f31-b194-5da911d0b7ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:12.245850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dcfe4-b582-4f31-b194-5da911d0b7ff None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:12.257971 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 436/880] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:12.264011 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:12.286044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:12.366139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e325-1578-4625-bb08-f1940e8eb538 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:12.406338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72618b8d-eb4f-48a3-bd1e-4796ea7535aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:12.407096 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618b8d-eb4f-48a3-bd1e-4796ea7535aa None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:12.407400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618b8d-eb4f-48a3-bd1e-4796ea7535aa None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:12.407727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618b8d-eb4f-48a3-bd1e-4796ea7535aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:12.408656 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72618b8d-eb4f-48a3-bd1e-4796ea7535aa None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=cf8e06cedc354cf9b5896752243693a9) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:12.408950 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72618b8d-eb4f-48a3-bd1e-4796ea7535aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:12.410934 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72618b8d-eb4f-48a3-bd1e-4796ea7535aa None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:12.416317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 445/881] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:12:12 2022] GET /identity/v3/role_assignments?user.id=cf8e06cedc354cf9b5896752243693a9&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=40fb60241dc645059f308de1b41e6e44 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:14.734007 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76706456-178e-417c-a66b-3963264043a7 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:14.734553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76706456-178e-417c-a66b-3963264043a7 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:14.734553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76706456-178e-417c-a66b-3963264043a7 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:14.735902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 437/882] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:14.742167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d8e0-ad84-49e7-ab55-f91113e36ad1 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:14.742556 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d8e0-ad84-49e7-ab55-f91113e36ad1 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:14.742723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d8e0-ad84-49e7-ab55-f91113e36ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:14.761045 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-ea02d8e0-ad84-49e7-ab55-f91113e36ad1 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:14.762254 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-ea02d8e0-ad84-49e7-ab55-f91113e36ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:14.827879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 446/883] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:14 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:14.852517 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76706456-178e-417c-a66b-3963264043a7 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:14.864165 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:14.955208 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76706456-178e-417c-a66b-3963264043a7 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:14.989905 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:14.990472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:14.990755 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:14.991029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:15.001070 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:12:15.006913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:15.008013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:15.009002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 438/884] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:15.014201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d8e0-ad84-49e7-ab55-f91113e36ad1 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:15.029524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:15.111963 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d8e0-ad84-49e7-ab55-f91113e36ad1 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:15.145948 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:15.146557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:15.146839 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:15.147113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:15.147818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:15.148122 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:15.149464 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:15.157539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 447/885] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:15.163758 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:15.230254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:15.268129 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded4d0d-711e-4c08-b8c2-3502a061d020 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:15.302190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:15.302834 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:15.303116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:15.303392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:15.313037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:15.314503 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:15.330251 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:15.331392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:15.332469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:15.332469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:15.332469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:15.332469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:15.332469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 439/886] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:15.337435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:15.428637 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:15.452151 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7086d00-51f2-4db0-a521-3c295066bb54 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:15.485413 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:15.486054 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:15.486334 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:15.486605 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:15.487276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:15.488224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:15.489590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:15.501157 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 448/887] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:15.507005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:15.605486 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4bb39-d854-461d-ba35-9b443551ed63 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:15.627368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:15.641977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:15.642617 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:15.642901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:15.643177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:15.651130 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:15.652551 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:12:15.664431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:15.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:15.666586 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:15.669715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 440/888] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:15.671480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:15.772416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9ab8-a7a3-4731-9d61-053a137a20c2 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:15.805680 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:15.806314 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:15.806590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:15.806861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:15.807632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:15.807932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:15.809333 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:15.811828 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:15.827134 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 449/889] 10.222.0.71 () {56 vars in 1143 bytes} [Wed Jul 27 19:12:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:15.832826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:15.930945 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68f1c4-99d3-483a-82f6-322fc136a98b None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:15.963539 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:15.964172 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:15.964454 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:15.964726 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:15.975055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:15.976492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:15.990705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:15.991785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:15.993285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:15.993285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:15.993285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:15.993285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:15.993285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 441/890] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:15.997849 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:16.097207 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474d26d-548c-459e-80ce-5121eed4fb63 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:16.132912 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:16.133525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:16.133834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:16.134113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:16.134789 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:16.135091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:16.136446 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:16.147827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 450/891] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:16.153518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:16.185390 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:16.252427 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a81f82-71d9-4212-a7a4-7d28b1048439 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:16.286457 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:16.287094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:16.287376 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:16.287652 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:16.294106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:16.295537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:12:16.307392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:16.308420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:16.309545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 442/892] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:16.314367 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:16.372497 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:16.420044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aaba8-9abe-49c0-a3b7-94f96c64cc6a None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:16.452743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bbbaf-ead0-4a0d-8270-cb72967ab2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:16.453285 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bbbaf-ead0-4a0d-8270-cb72967ab2d0 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:16.453562 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bbbaf-ead0-4a0d-8270-cb72967ab2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:16.453864 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bbbaf-ead0-4a0d-8270-cb72967ab2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:16.454598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bbbaf-ead0-4a0d-8270-cb72967ab2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:16.454900 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bbbaf-ead0-4a0d-8270-cb72967ab2d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:16.456350 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bbbaf-ead0-4a0d-8270-cb72967ab2d0 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:16.468086 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 451/893] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:16.474932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:16.564472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:16.573418 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353fe4-2ace-4eee-a99b-1ab2b49993ff None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:16.606636 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81594ad8-5ee5-4157-a75b-9dbb191e645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:16.607297 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594ad8-5ee5-4157-a75b-9dbb191e645b None admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:16.607580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594ad8-5ee5-4157-a75b-9dbb191e645b None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:16.607856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594ad8-5ee5-4157-a75b-9dbb191e645b None admin] PATH_INFO: `/v3/projects/074f3318a4b34aac85f631b95f159c12/users/cf8e06cedc354cf9b5896752243693a9/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:16.609802 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81594ad8-5ee5-4157-a75b-9dbb191e645b None admin] RBAC: Authorizing `identity:create_grant(project_id=074f3318a4b34aac85f631b95f159c12, user_id=cf8e06cedc354cf9b5896752243693a9, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:16.611228 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81594ad8-5ee5-4157-a75b-9dbb191e645b None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:16.625391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 443/894] 10.222.0.71 () {58 vars in 1439 bytes} [Wed Jul 27 19:12:16 2022] PUT /identity/v3/projects/074f3318a4b34aac85f631b95f159c12/users/cf8e06cedc354cf9b5896752243693a9/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:12:18.837153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e737c-9f5d-4b13-a787-6be1460eee56 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:18.837708 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e737c-9f5d-4b13-a787-6be1460eee56 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:18.837820 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e737c-9f5d-4b13-a787-6be1460eee56 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:18.839092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 452/895] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:18.844468 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476cd4-5e9e-42ed-b74d-d01cf52833a1 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:18.844916 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476cd4-5e9e-42ed-b74d-d01cf52833a1 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:18.845016 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476cd4-5e9e-42ed-b74d-d01cf52833a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:18.863359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-c8476cd4-5e9e-42ed-b74d-d01cf52833a1 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:18.864537 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-c8476cd4-5e9e-42ed-b74d-d01cf52833a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:18.930378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 444/896] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:18 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:18.955837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e737c-9f5d-4b13-a787-6be1460eee56 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:19.056240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e737c-9f5d-4b13-a787-6be1460eee56 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:19.069726 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:19.090294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:19.090931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:19.091210 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:19.091480 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:19.101897 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 19:12:19.106652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:19.107774 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:19.108830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 453/897] 10.222.0.71 () {56 vars in 1096 bytes} [Wed Jul 27 19:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:19.114134 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476cd4-5e9e-42ed-b74d-d01cf52833a1 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:19.194531 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:19.214355 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476cd4-5e9e-42ed-b74d-d01cf52833a1 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:19.255321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:19.255958 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:19.256238 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:19.256506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:19.257218 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:19.257514 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:19.258903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:19.267448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 445/898] 10.222.0.71 () {56 vars in 1099 bytes} [Wed Jul 27 19:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:19.274149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:19.380224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03532-4ea2-482a-8a1e-4956b174bd0c None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:19.420519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:19.421212 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:19.421537 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:19.421965 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:19.432771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:19.434243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:19.449336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:19.450441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:19.451544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:19.451544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:19.451544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:19.451544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:19.451544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 454/899] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:19.456942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:19.557031 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080823-fc14-4414-9020-06dff3e1a90a None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:19.590698 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:19.591317 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:19.591598 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:19.591868 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:19.592547 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:19.592849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:19.594237 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:19.605987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 446/900] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:19.611842 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:19.641990 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:19.717725 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14dd2d-2ce1-483c-a6ad-aa0368b27cfb None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:19.754658 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:19.755306 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:19.755584 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:19.755851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:19.764142 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:19.765566 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 19:12:19.777356 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:19.778507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:19.779812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 455/901] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:19.785118 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:19.788961 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:19.885391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42164505-3228-43e1-b45a-1ab134f3398e None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:19.920682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:19.921297 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:19.921576 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:19.921875 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:19.922650 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:19.922975 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:19.924383 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:19.942008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 447/902] 10.222.0.71 () {56 vars in 1143 bytes} [Wed Jul 27 19:12:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:19.947811 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:20.032808 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:20.048196 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913b06-5fb2-44b2-bfe4-2039920572a4 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:20.081263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:20.081901 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:20.082185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:20.082458 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:20.150984 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:20.152421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:20.235054 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:20.251725 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 456/903] 10.222.0.71 () {58 vars in 1282 bytes} [Wed Jul 27 19:12:19 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 19:12:20.257784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:20.320159 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:20.363040 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ea61e-a503-4025-90fa-3d711c23b349 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:20.396873 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:20.397504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:20.397814 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:20.398087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:20.407640 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:20.409062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 19:12:20.423906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:20.425086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:20.426097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 19:12:20.426097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 19:12:20.426097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 19:12:20.426097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:20.426097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 448/904] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:20.430964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:20.528069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92989-a879-4db4-bc21-0dfdf9496827 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:20.560670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:20.561264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:20.561539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:20.561841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:20.562514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:20.562810 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:20.564142 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:20.575140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 457/905] 10.222.0.71 () {56 vars in 1109 bytes} [Wed Jul 27 19:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:20.580764 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:20.686482 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570fc2-de39-4df4-a2a6-4e30562f82ca None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:20.700327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:20.720996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:20.721670 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:20.722067 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:20.722436 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:20.729105 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:20.730562 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 19:12:20.742396 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:20.743710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: ERROR keystone.server.flask.application Jul 27 19:12:20.744788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 449/906] 10.222.0.71 () {56 vars in 1111 bytes} [Wed Jul 27 19:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:20.749664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:20.797319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:20.851264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6e2b-2520-4350-a209-e7459e2cdb30 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:20.884479 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60202d2a-15b5-4444-bcbd-1ff127800410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:20.885089 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60202d2a-15b5-4444-bcbd-1ff127800410 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:20.885365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60202d2a-15b5-4444-bcbd-1ff127800410 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:20.885633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60202d2a-15b5-4444-bcbd-1ff127800410 None admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:20.886398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60202d2a-15b5-4444-bcbd-1ff127800410 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:20.886700 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60202d2a-15b5-4444-bcbd-1ff127800410 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:20.888102 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60202d2a-15b5-4444-bcbd-1ff127800410 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:20.899819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 458/907] 10.222.0.71 () {56 vars in 1148 bytes} [Wed Jul 27 19:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:20.905882 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:21.010024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e4354-f848-449f-b7f7-f254b1d0bbae None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:21.044088 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d2811-630f-4e5b-b22b-ba9d8c693940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:21.044693 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2811-630f-4e5b-b22b-ba9d8c693940 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:21.044971 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2811-630f-4e5b-b22b-ba9d8c693940 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:21.045265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2811-630f-4e5b-b22b-ba9d8c693940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:21.046069 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d2811-630f-4e5b-b22b-ba9d8c693940 None admin] RBAC: Adding query filter params (role.id=40fb60241dc645059f308de1b41e6e44, scope.project.id=074f3318a4b34aac85f631b95f159c12, user.id=cf8e06cedc354cf9b5896752243693a9) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:21.046375 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d2811-630f-4e5b-b22b-ba9d8c693940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:21.047833 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d2811-630f-4e5b-b22b-ba9d8c693940 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:21.053413 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 450/908] 10.222.0.71 () {56 vars in 1374 bytes} [Wed Jul 27 19:12:20 2022] GET /identity/v3/role_assignments?user.id=cf8e06cedc354cf9b5896752243693a9&scope.project.id=074f3318a4b34aac85f631b95f159c12&role.id=40fb60241dc645059f308de1b41e6e44 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:23.330520 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ab2a-5f0c-487a-b52f-365bc5e0a946 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:23.331109 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ab2a-5f0c-487a-b52f-365bc5e0a946 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:23.331109 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ab2a-5f0c-487a-b52f-365bc5e0a946 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:23.332930 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 459/909] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:23.338448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef424-3653-4048-a628-d5652a192c8b None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:23.338861 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef424-3653-4048-a628-d5652a192c8b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:23.339002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef424-3653-4048-a628-d5652a192c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:23.358141 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-2d5ef424-3653-4048-a628-d5652a192c8b None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:23.359378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-2d5ef424-3653-4048-a628-d5652a192c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:23.393510 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:23.434063 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 451/910] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:23 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:23.458536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ab2a-5f0c-487a-b52f-365bc5e0a946 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:23.562268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ab2a-5f0c-487a-b52f-365bc5e0a946 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:23.571695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:23.600723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:23.601276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:23.601555 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:23.601861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:23.602482 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:23.603822 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:23.613215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:23.614515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:23.615581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 460/911] 10.222.0.71 () {56 vars in 1117 bytes} [Wed Jul 27 19:12:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:23.620844 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef424-3653-4048-a628-d5652a192c8b None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:23.723104 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef424-3653-4048-a628-d5652a192c8b None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:23.757389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c1c1-c95c-45a5-98ab-52b451b219b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:23.758067 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c1c1-c95c-45a5-98ab-52b451b219b1 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:23.758352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c1c1-c95c-45a5-98ab-52b451b219b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:23.758629 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c1c1-c95c-45a5-98ab-52b451b219b1 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:23.759332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c1c1-c95c-45a5-98ab-52b451b219b1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:23.759639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c1c1-c95c-45a5-98ab-52b451b219b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:23.760988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c1c1-c95c-45a5-98ab-52b451b219b1 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:23.765702 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 452/912] 10.222.0.71 () {56 vars in 1116 bytes} [Wed Jul 27 19:12:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:23.773007 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:23.873474 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded7d6-33d4-4c15-8019-b4e788e8ba79 None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:23.910745 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9bbc-497f-4522-a418-d70d21fbc0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:23.911355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9bbc-497f-4522-a418-d70d21fbc0e4 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:23.911631 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9bbc-497f-4522-a418-d70d21fbc0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:23.911901 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9bbc-497f-4522-a418-d70d21fbc0e4 None admin] PATH_INFO: `/v3/services` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:23.912561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9bbc-497f-4522-a418-d70d21fbc0e4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:23.912859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9bbc-497f-4522-a418-d70d21fbc0e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:23.914240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9bbc-497f-4522-a418-d70d21fbc0e4 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:23.918581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 461/913] 10.222.0.71 () {56 vars in 1116 bytes} [Wed Jul 27 19:12:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:26.182389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77130d-e3d3-4bfe-8ef8-e963ad392391 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:26.182987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77130d-e3d3-4bfe-8ef8-e963ad392391 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:26.182987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77130d-e3d3-4bfe-8ef8-e963ad392391 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:26.184298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 453/914] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:26.189900 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944379-26a9-4f3a-83cd-949c863c638c None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:26.190317 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944379-26a9-4f3a-83cd-949c863c638c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:26.191028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944379-26a9-4f3a-83cd-949c863c638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:26.209519 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-84944379-26a9-4f3a-83cd-949c863c638c None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:26.210737 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-84944379-26a9-4f3a-83cd-949c863c638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:26.237052 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:26.280403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 462/915] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:26 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:26.305128 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77130d-e3d3-4bfe-8ef8-e963ad392391 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:26.336323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:26.433954 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77130d-e3d3-4bfe-8ef8-e963ad392391 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:26.468751 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c2ecc-b473-42ec-b9e7-59a8b1922751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:26.469372 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2ecc-b473-42ec-b9e7-59a8b1922751 None admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:26.469674 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2ecc-b473-42ec-b9e7-59a8b1922751 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:26.469964 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2ecc-b473-42ec-b9e7-59a8b1922751 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:26.470655 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c2ecc-b473-42ec-b9e7-59a8b1922751 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:26.472097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c2ecc-b473-42ec-b9e7-59a8b1922751 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:26.486705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 454/916] 10.222.0.71 () {60 vars in 1141 bytes} [Wed Jul 27 19:12:26 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:12:28.789727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75e79-f01a-4e25-a7b8-aed11236245f None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:28.790290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75e79-f01a-4e25-a7b8-aed11236245f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:28.790290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75e79-f01a-4e25-a7b8-aed11236245f None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:28.791627 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 463/917] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:28.796823 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367a0b4-fd09-40dd-8fb9-71f7324b4bc5 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:28.797210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367a0b4-fd09-40dd-8fb9-71f7324b4bc5 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:28.797410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367a0b4-fd09-40dd-8fb9-71f7324b4bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:28.816187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-a367a0b4-fd09-40dd-8fb9-71f7324b4bc5 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:28.817360 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a367a0b4-fd09-40dd-8fb9-71f7324b4bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:28.888639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 455/918] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:28 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:28.912706 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75e79-f01a-4e25-a7b8-aed11236245f None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:29.013011 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75e79-f01a-4e25-a7b8-aed11236245f None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:29.046932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:29.047578 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:29.047858 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:29.048131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:29.048750 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:29.050137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:29.059639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:29.060815 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:29.061697 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 464/919] 10.222.0.71 () {56 vars in 1117 bytes} [Wed Jul 27 19:12:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:29.067228 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367a0b4-fd09-40dd-8fb9-71f7324b4bc5 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:29.085023 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:29.170457 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367a0b4-fd09-40dd-8fb9-71f7324b4bc5 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:29.204770 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:29.205392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:29.205693 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:29.205969 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:29.206640 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:29.206940 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:29.209066 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:29.214241 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 456/920] 10.222.0.71 () {56 vars in 1116 bytes} [Wed Jul 27 19:12:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:29.220279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:29.249397 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:29.333427 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76c8d-f58c-4d65-8158-2887b0d49f0e None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:29.376281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b3d17-83d9-4ca1-ac78-786556557e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:29.376929 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3d17-83d9-4ca1-ac78-786556557e25 None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:29.377238 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3d17-83d9-4ca1-ac78-786556557e25 None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:29.377510 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3d17-83d9-4ca1-ac78-786556557e25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:29.378350 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b3d17-83d9-4ca1-ac78-786556557e25 None admin] RBAC: Adding query filter params (interface=public, service_id=4f1674d556c945f69d1e865d4fa8ae5f, region_id=RegionOne) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:29.378702 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b3d17-83d9-4ca1-ac78-786556557e25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:29.381033 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b3d17-83d9-4ca1-ac78-786556557e25 None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:29.387268 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 465/921] 10.222.0.71 () {56 vars in 1251 bytes} [Wed Jul 27 19:12:29 2022] GET /identity/v3/endpoints?service_id=4f1674d556c945f69d1e865d4fa8ae5f&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:29.393872 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:29.491879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:29.514531 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa94b9-5e3a-4b00-ba48-63630db586b2 None admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:29.556734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d72bb-193a-4cb7-9c80-65d80d9cf618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:29.557378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d72bb-193a-4cb7-9c80-65d80d9cf618 None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:29.557695 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d72bb-193a-4cb7-9c80-65d80d9cf618 None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:29.557973 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d72bb-193a-4cb7-9c80-65d80d9cf618 None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:29.558643 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d72bb-193a-4cb7-9c80-65d80d9cf618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:29.560080 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d72bb-193a-4cb7-9c80-65d80d9cf618 None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:29.568066 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 457/922] 10.222.0.71 () {56 vars in 1087 bytes} [Wed Jul 27 19:12:29 2022] GET /identity/v3/services => generated 1962 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:12:31.886558 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f5dd-cb44-478d-9129-3633bb0128a6 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:31.887091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f5dd-cb44-478d-9129-3633bb0128a6 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:31.887091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f5dd-cb44-478d-9129-3633bb0128a6 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:31.888483 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 466/923] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:12:31.894258 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16506c9-9824-4fd2-a00a-c5bcf7b8bffc None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:31.894798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16506c9-9824-4fd2-a00a-c5bcf7b8bffc None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:31.894978 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16506c9-9824-4fd2-a00a-c5bcf7b8bffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:31.914291 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-d16506c9-9824-4fd2-a00a-c5bcf7b8bffc None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:12:31.915502 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-d16506c9-9824-4fd2-a00a-c5bcf7b8bffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:12:31.986392 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 458/924] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:12:31 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 19:12:32.011046 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519f5dd-cb44-478d-9129-3633bb0128a6 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:32.112761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:32.125474 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519f5dd-cb44-478d-9129-3633bb0128a6 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:32.161700 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:32.162523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:32.162801 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:32.163072 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:32.163687 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:32.165029 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 19:12:32.174187 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 19:12:32.175411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application with Lock( Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self._enter() Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application return self.creator() Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application created_value = creator( Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: ERROR keystone.server.flask.application Jul 27 19:12:32.176914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 467/925] 10.222.0.71 () {56 vars in 1117 bytes} [Wed Jul 27 19:12:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 19:12:32.183248 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16506c9-9824-4fd2-a00a-c5bcf7b8bffc None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:32.261863 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:32.285813 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16506c9-9824-4fd2-a00a-c5bcf7b8bffc None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:32.321545 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1a36-b496-4e29-a009-6509ba2fd7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:32.322210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1a36-b496-4e29-a009-6509ba2fd7dc None admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:32.322495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1a36-b496-4e29-a009-6509ba2fd7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:32.322773 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1a36-b496-4e29-a009-6509ba2fd7dc None admin] PATH_INFO: `/v3/services` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:32.323451 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1a36-b496-4e29-a009-6509ba2fd7dc None admin] RBAC: Adding query filter params (name=placement) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:12:32.323759 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1a36-b496-4e29-a009-6509ba2fd7dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:32.325127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1a36-b496-4e29-a009-6509ba2fd7dc None admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:32.330987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 459/926] 10.222.0.71 () {56 vars in 1116 bytes} [Wed Jul 27 19:12:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:12:32.337457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:12:32.450411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd7b7-39d8-48fc-8463-9794db06b8bc None admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:12:32.487694 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738940-02ab-4a06-8e65-e24a1015d19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:12:32.488320 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738940-02ab-4a06-8e65-e24a1015d19e None admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:12:32.488601 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738940-02ab-4a06-8e65-e24a1015d19e None admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:12:32.489066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738940-02ab-4a06-8e65-e24a1015d19e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:12:32.490406 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738940-02ab-4a06-8e65-e24a1015d19e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:12:32.491791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738940-02ab-4a06-8e65-e24a1015d19e None admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:12:32.515506 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 468/927] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:12:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:12:42.327886 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=30 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:12:42.510126 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:34.820395 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559426-471c-4df1-b726-048830e1364d None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:34.820972 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559426-471c-4df1-b726-048830e1364d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:34.820972 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559426-471c-4df1-b726-048830e1364d None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:34.822615 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 460/928] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:34.828312 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4cd4-e2db-4f90-9823-b4364132d4bd None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:34.829027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4cd4-e2db-4f90-9823-b4364132d4bd None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:34.829027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4cd4-e2db-4f90-9823-b4364132d4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:34.850786 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-537f4cd4-e2db-4f90-9823-b4364132d4bd None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:34.852039 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-537f4cd4-e2db-4f90-9823-b4364132d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:34.952821 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 469/929] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:35.017040 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c04dd-b5af-4fe6-ac4f-1bf1ee3879b8 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:35.017773 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c04dd-b5af-4fe6-ac4f-1bf1ee3879b8 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:35.018416 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c04dd-b5af-4fe6-ac4f-1bf1ee3879b8 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:35.022647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 461/930] 10.222.0.71 () {54 vars in 965 bytes} [Wed Jul 27 19:13:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:35.032459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4965-f4a7-4ca7-a4a7-ce4b95f07031 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:35.033073 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4965-f4a7-4ca7-a4a7-ce4b95f07031 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:35.033597 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4965-f4a7-4ca7-a4a7-ce4b95f07031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:35.153170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-904a4965-f4a7-4ca7-a4a7-ce4b95f07031 None None] MFA Rules not processed for user `d6d1644bffa94434900353bf4a2fecea`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:35.154435 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-904a4965-f4a7-4ca7-a4a7-ce4b95f07031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:35.265902 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 470/931] 10.222.0.71 () {58 vars in 1062 bytes} [Wed Jul 27 19:13:35 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:35.276653 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c04dd-b5af-4fe6-ac4f-1bf1ee3879b8 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:35.289219 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c04dd-b5af-4fe6-ac4f-1bf1ee3879b8 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:35.293519 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3cf9c-4d35-4f19-b7fd-44516bf9e7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:35.294391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3cf9c-4d35-4f19-b7fd-44516bf9e7ee service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:35.294856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3cf9c-4d35-4f19-b7fd-44516bf9e7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:35.295351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3cf9c-4d35-4f19-b7fd-44516bf9e7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:35.308309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3cf9c-4d35-4f19-b7fd-44516bf9e7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:35.311181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3cf9c-4d35-4f19-b7fd-44516bf9e7ee service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:35.328528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 462/932] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:38.305594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17663fd9-baa3-4c56-9b9b-38ddd157f712 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:38.306335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17663fd9-baa3-4c56-9b9b-38ddd157f712 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:38.306660 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17663fd9-baa3-4c56-9b9b-38ddd157f712 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:38.309310 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 471/933] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:38.317781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d5cf-666d-4ab1-bbfc-426afb8d4876 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:38.318313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d5cf-666d-4ab1-bbfc-426afb8d4876 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:38.318488 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d5cf-666d-4ab1-bbfc-426afb8d4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:38.341293 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-59f7d5cf-666d-4ab1-bbfc-426afb8d4876 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:38.342724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-59f7d5cf-666d-4ab1-bbfc-426afb8d4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:38.351540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 463/934] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:38.398845 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17663fd9-baa3-4c56-9b9b-38ddd157f712 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:38.411585 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17663fd9-baa3-4c56-9b9b-38ddd157f712 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:38.417338 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8caf9-3bd0-4628-9ff0-9075b435b630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:38.418692 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8caf9-3bd0-4628-9ff0-9075b435b630 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:38.419253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8caf9-3bd0-4628-9ff0-9075b435b630 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:38.419856 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8caf9-3bd0-4628-9ff0-9075b435b630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:38.437125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8caf9-3bd0-4628-9ff0-9075b435b630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:38.439671 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8caf9-3bd0-4628-9ff0-9075b435b630 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:38.458633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 472/935] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:41.345906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4f88-3c71-48e2-afd9-88625a79be53 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:41.346714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4f88-3c71-48e2-afd9-88625a79be53 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:41.346714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4f88-3c71-48e2-afd9-88625a79be53 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:41.347904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 464/936] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:13:41.355132 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b29fe-318e-4a36-a7c6-64836612d035 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:41.355639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b29fe-318e-4a36-a7c6-64836612d035 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:41.356216 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b29fe-318e-4a36-a7c6-64836612d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:41.431447 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-532b29fe-318e-4a36-a7c6-64836612d035 None None] MFA Rules not processed for user `b49cb583333c4029958b28bd0ef12234`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:41.434032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-532b29fe-318e-4a36-a7c6-64836612d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:41.501601 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:41.561703 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 473/937] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:41 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:41.630389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a4f88-3c71-48e2-afd9-88625a79be53 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:41.649201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a4f88-3c71-48e2-afd9-88625a79be53 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:41.655694 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917c0a-7436-40e4-8a77-df4854891e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:41.656778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917c0a-7436-40e4-8a77-df4854891e9c service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:41.657267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917c0a-7436-40e4-8a77-df4854891e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:41.657802 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917c0a-7436-40e4-8a77-df4854891e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:41.676463 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917c0a-7436-40e4-8a77-df4854891e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:41.679423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917c0a-7436-40e4-8a77-df4854891e9c service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:41.699635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 465/938] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:41 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:44.884783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e090-ca8d-4b95-afa3-717dd00b4fae None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:44.885360 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e090-ca8d-4b95-afa3-717dd00b4fae None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:44.885360 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e090-ca8d-4b95-afa3-717dd00b4fae None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:44.886747 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 474/939] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:44.892692 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350738b-7216-4ff8-b1df-8cc11d08db78 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:44.893155 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350738b-7216-4ff8-b1df-8cc11d08db78 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:44.893268 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350738b-7216-4ff8-b1df-8cc11d08db78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:44.916051 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-3350738b-7216-4ff8-b1df-8cc11d08db78 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:44.917279 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-3350738b-7216-4ff8-b1df-8cc11d08db78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:44.996248 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 466/940] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:44 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:45.056998 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1234-3d6a-49f2-b342-32869d3334a3 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:45.057449 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1234-3d6a-49f2-b342-32869d3334a3 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:45.057952 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1234-3d6a-49f2-b342-32869d3334a3 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:45.060418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 475/941] 10.222.0.71 () {54 vars in 965 bytes} [Wed Jul 27 19:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:45.068089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6d60-a93d-43ec-affe-ad51a7ab8bb4 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:45.068386 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6d60-a93d-43ec-affe-ad51a7ab8bb4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:45.068665 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6d60-a93d-43ec-affe-ad51a7ab8bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:45.089816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-3d7b6d60-a93d-43ec-affe-ad51a7ab8bb4 None None] MFA Rules not processed for user `d6d1644bffa94434900353bf4a2fecea`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:45.091029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-3d7b6d60-a93d-43ec-affe-ad51a7ab8bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:45.098725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 467/942] 10.222.0.71 () {58 vars in 1062 bytes} [Wed Jul 27 19:13:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:13:45.108035 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d1234-3d6a-49f2-b342-32869d3334a3 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:45.120495 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d1234-3d6a-49f2-b342-32869d3334a3 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:45.124337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde4b4a-3b1d-40d9-8171-50544ddde42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:45.124947 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4b4a-3b1d-40d9-8171-50544ddde42c service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:45.125223 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4b4a-3b1d-40d9-8171-50544ddde42c service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:45.125494 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4b4a-3b1d-40d9-8171-50544ddde42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:45.136459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde4b4a-3b1d-40d9-8171-50544ddde42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:45.137940 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde4b4a-3b1d-40d9-8171-50544ddde42c service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:45.149362 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 476/943] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:45 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:48.746533 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b554fb-8c4a-471d-b627-97c19be5144e None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:48.754561 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b554fb-8c4a-471d-b627-97c19be5144e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:48.754561 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b554fb-8c4a-471d-b627-97c19be5144e None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:48.754561 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 468/944] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:48.755388 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b545047-a4bd-4977-96fd-3c1e2d186abd None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:48.756049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b545047-a4bd-4977-96fd-3c1e2d186abd None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:48.756049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b545047-a4bd-4977-96fd-3c1e2d186abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:48.786869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-9b545047-a4bd-4977-96fd-3c1e2d186abd None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:48.788389 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9b545047-a4bd-4977-96fd-3c1e2d186abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:48.796336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 477/945] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:48.835639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b554fb-8c4a-471d-b627-97c19be5144e None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:48.847198 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b554fb-8c4a-471d-b627-97c19be5144e None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:48.851609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac82a5-9108-4efd-b0d6-7c1ddc3a25ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:48.852239 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac82a5-9108-4efd-b0d6-7c1ddc3a25ee service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:48.852518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac82a5-9108-4efd-b0d6-7c1ddc3a25ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:48.852791 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac82a5-9108-4efd-b0d6-7c1ddc3a25ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:48.864353 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac82a5-9108-4efd-b0d6-7c1ddc3a25ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:48.865837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac82a5-9108-4efd-b0d6-7c1ddc3a25ee service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:48.876962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 469/946] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:13:51.275788 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee7ae-07ce-438e-ac48-eb9b1cd3e539 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:51.276294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee7ae-07ce-438e-ac48-eb9b1cd3e539 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:51.276294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee7ae-07ce-438e-ac48-eb9b1cd3e539 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:51.278420 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 478/947] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:51.285043 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35935bc-824b-43f3-8b7f-ec5c06a764d7 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:51.285869 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35935bc-824b-43f3-8b7f-ec5c06a764d7 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:51.285869 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35935bc-824b-43f3-8b7f-ec5c06a764d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:51.307799 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e35935bc-824b-43f3-8b7f-ec5c06a764d7 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:51.309029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e35935bc-824b-43f3-8b7f-ec5c06a764d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:51.317321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 470/948] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:51.355959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee7ae-07ce-438e-ac48-eb9b1cd3e539 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:51.369626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee7ae-07ce-438e-ac48-eb9b1cd3e539 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:51.374926 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aea870-6c0d-493c-bd8e-69d37be7d43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:51.375746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aea870-6c0d-493c-bd8e-69d37be7d43e service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:51.376156 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aea870-6c0d-493c-bd8e-69d37be7d43e service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:51.376615 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aea870-6c0d-493c-bd8e-69d37be7d43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:51.387308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aea870-6c0d-493c-bd8e-69d37be7d43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:51.388753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aea870-6c0d-493c-bd8e-69d37be7d43e service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:51.400163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 479/949] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:53.776815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0d599-03b3-4eb4-b110-2427717366ed None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:53.777478 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0d599-03b3-4eb4-b110-2427717366ed None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:53.777614 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0d599-03b3-4eb4-b110-2427717366ed None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:53.779377 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 471/950] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:53.786099 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f833bdd-f877-4697-b93c-89a493926054 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:53.786635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f833bdd-f877-4697-b93c-89a493926054 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:53.786635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f833bdd-f877-4697-b93c-89a493926054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:53.812817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-8f833bdd-f877-4697-b93c-89a493926054 None None] MFA Rules not processed for user `b49cb583333c4029958b28bd0ef12234`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:53.814125 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-8f833bdd-f877-4697-b93c-89a493926054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:53.823331 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 480/951] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:53 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:53.868310 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0d599-03b3-4eb4-b110-2427717366ed None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:53.880158 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0d599-03b3-4eb4-b110-2427717366ed None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:53.883903 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25056b34-5f07-4e30-9a43-625790f03cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:53.884528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056b34-5f07-4e30-9a43-625790f03cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:53.884802 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056b34-5f07-4e30-9a43-625790f03cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:53.885080 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25056b34-5f07-4e30-9a43-625790f03cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:53.895590 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25056b34-5f07-4e30-9a43-625790f03cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:53.897030 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25056b34-5f07-4e30-9a43-625790f03cf7 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:53.911672 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 472/952] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:53 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:56.572184 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a3fb-b00f-47f1-a1a8-c088979cd804 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:56.572722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a3fb-b00f-47f1-a1a8-c088979cd804 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:56.572722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a3fb-b00f-47f1-a1a8-c088979cd804 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:56.574051 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 481/953] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:56.579870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7180d7-3182-43d8-87f6-3c5c072aed76 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:56.580417 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7180d7-3182-43d8-87f6-3c5c072aed76 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:56.580417 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7180d7-3182-43d8-87f6-3c5c072aed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:56.602830 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-ac7180d7-3182-43d8-87f6-3c5c072aed76 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:56.604095 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-ac7180d7-3182-43d8-87f6-3c5c072aed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:56.612318 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 473/954] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:56.654981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150a3fb-b00f-47f1-a1a8-c088979cd804 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:56.668927 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150a3fb-b00f-47f1-a1a8-c088979cd804 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:56.672691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1f0b7-adc8-45f2-a9be-c42e8320c888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:56.673335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f0b7-adc8-45f2-a9be-c42e8320c888 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:56.673622 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f0b7-adc8-45f2-a9be-c42e8320c888 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:56.673925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f0b7-adc8-45f2-a9be-c42e8320c888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:56.684790 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1f0b7-adc8-45f2-a9be-c42e8320c888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:56.686310 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1f0b7-adc8-45f2-a9be-c42e8320c888 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:56.697670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 482/955] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:13:59.041287 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f93ca-fc83-4f23-b2ce-5b1fd63c8d2e None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:59.041842 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f93ca-fc83-4f23-b2ce-5b1fd63c8d2e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:59.041936 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f93ca-fc83-4f23-b2ce-5b1fd63c8d2e None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:59.043254 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 474/956] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:59.050425 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5480271-950f-4418-b729-7e65ec583524 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:59.051208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5480271-950f-4418-b729-7e65ec583524 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:59.051208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5480271-950f-4418-b729-7e65ec583524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:59.079018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-c5480271-950f-4418-b729-7e65ec583524 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:59.080229 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-c5480271-950f-4418-b729-7e65ec583524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:59.090020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 483/957] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:13:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:59.135144 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f93ca-fc83-4f23-b2ce-5b1fd63c8d2e None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:59.147209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f93ca-fc83-4f23-b2ce-5b1fd63c8d2e None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:59.152144 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc221-c6fe-4e43-926c-aa78de2f3bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:59.152818 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc221-c6fe-4e43-926c-aa78de2f3bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:59.153096 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc221-c6fe-4e43-926c-aa78de2f3bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:59.153385 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc221-c6fe-4e43-926c-aa78de2f3bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:59.163544 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bc221-c6fe-4e43-926c-aa78de2f3bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:59.164991 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bc221-c6fe-4e43-926c-aa78de2f3bd8 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:59.176013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 475/958] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:01.936391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b6a8-7118-47f4-8648-388f5aa3b575 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:01.936979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b6a8-7118-47f4-8648-388f5aa3b575 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:01.937214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b6a8-7118-47f4-8648-388f5aa3b575 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:01.939092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 484/959] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:01.946199 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094abbb-7ff8-4d46-876b-d7bc1ea34342 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:01.946707 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094abbb-7ff8-4d46-876b-d7bc1ea34342 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:01.946798 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094abbb-7ff8-4d46-876b-d7bc1ea34342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:01.966151 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e094abbb-7ff8-4d46-876b-d7bc1ea34342 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:01.967325 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e094abbb-7ff8-4d46-876b-d7bc1ea34342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:01.975550 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 476/960] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:01 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:14:02.013020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8b6a8-7118-47f4-8648-388f5aa3b575 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:02.028087 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8b6a8-7118-47f4-8648-388f5aa3b575 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:02.031792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a5f9-196d-4360-9544-286c4f52248d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:02.032410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a5f9-196d-4360-9544-286c4f52248d service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:02.032687 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a5f9-196d-4360-9544-286c4f52248d service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:02.032959 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a5f9-196d-4360-9544-286c4f52248d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:02.043527 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a5f9-196d-4360-9544-286c4f52248d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:02.045096 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a5f9-196d-4360-9544-286c4f52248d service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:02.055498 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 485/961] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:02 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:06.538679 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373c79-11b1-4aa4-b6a8-431149bd98e1 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:06.539250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373c79-11b1-4aa4-b6a8-431149bd98e1 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:06.539250 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373c79-11b1-4aa4-b6a8-431149bd98e1 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:06.540495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 477/962] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:06.546861 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732e4d-e8c4-4e33-bd5b-930dcff4ec0f None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:06.547678 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732e4d-e8c4-4e33-bd5b-930dcff4ec0f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:06.547827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732e4d-e8c4-4e33-bd5b-930dcff4ec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:06.569281 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-1d732e4d-e8c4-4e33-bd5b-930dcff4ec0f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:06.570555 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-1d732e4d-e8c4-4e33-bd5b-930dcff4ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:06.578746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 486/963] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:06.622623 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce373c79-11b1-4aa4-b6a8-431149bd98e1 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:06.631776 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=77 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:14:06.641187 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce373c79-11b1-4aa4-b6a8-431149bd98e1 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:06.647340 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869f231-7c48-4af1-96ad-fe27f540bd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:06.648149 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f231-7c48-4af1-96ad-fe27f540bd26 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:06.648624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f231-7c48-4af1-96ad-fe27f540bd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:06.649094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f231-7c48-4af1-96ad-fe27f540bd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:06.664277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869f231-7c48-4af1-96ad-fe27f540bd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:06.666919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869f231-7c48-4af1-96ad-fe27f540bd26 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:06.684267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 478/964] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:09.877527 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd647a5-2752-458d-8715-1ad2ba44db3c None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:09.878445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd647a5-2752-458d-8715-1ad2ba44db3c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:09.878445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd647a5-2752-458d-8715-1ad2ba44db3c None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:09.879895 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 487/965] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:09.885829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89c34-9acf-4caf-b10a-2a52052acf6f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:09.886288 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89c34-9acf-4caf-b10a-2a52052acf6f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:09.886633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89c34-9acf-4caf-b10a-2a52052acf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:09.907389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-afc89c34-9acf-4caf-b10a-2a52052acf6f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:09.908678 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-afc89c34-9acf-4caf-b10a-2a52052acf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:09.921908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 479/966] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:09 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:09.964427 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd647a5-2752-458d-8715-1ad2ba44db3c None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:09.976854 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd647a5-2752-458d-8715-1ad2ba44db3c None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:09.980691 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e22b6-5fe8-40b5-a6a0-e1271d19100b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:09.981401 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e22b6-5fe8-40b5-a6a0-e1271d19100b service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:09.981784 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e22b6-5fe8-40b5-a6a0-e1271d19100b service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:09.982123 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e22b6-5fe8-40b5-a6a0-e1271d19100b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:09.992718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e22b6-5fe8-40b5-a6a0-e1271d19100b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:09.994236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e22b6-5fe8-40b5-a6a0-e1271d19100b service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:10.005844 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 488/967] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:09 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:14.886272 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164db8b-b24d-4aae-8b8f-f5e72923b115 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:14.886846 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164db8b-b24d-4aae-8b8f-f5e72923b115 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:14.886846 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164db8b-b24d-4aae-8b8f-f5e72923b115 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:14.888222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 480/968] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:14.894558 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d890-41fc-40be-b523-2058ceeabab7 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:14.895264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d890-41fc-40be-b523-2058ceeabab7 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:14.895536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d890-41fc-40be-b523-2058ceeabab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:14.904091 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=54 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:14:14.919576 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-9f01d890-41fc-40be-b523-2058ceeabab7 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:14.920830 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9f01d890-41fc-40be-b523-2058ceeabab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:14.929921 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 489/969] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:14.976902 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164db8b-b24d-4aae-8b8f-f5e72923b115 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:14.989763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164db8b-b24d-4aae-8b8f-f5e72923b115 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:14.993635 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d845a2-2dd5-4113-a026-254a08cf081e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:14.994856 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d845a2-2dd5-4113-a026-254a08cf081e service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:14.995286 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d845a2-2dd5-4113-a026-254a08cf081e service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:14.995870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d845a2-2dd5-4113-a026-254a08cf081e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:15.012438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d845a2-2dd5-4113-a026-254a08cf081e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:15.013929 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d845a2-2dd5-4113-a026-254a08cf081e service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:15.025076 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 481/970] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:20.964107 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a41a-d3ee-4047-88cc-6bcb0b427f7f None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:20.964625 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a41a-d3ee-4047-88cc-6bcb0b427f7f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:20.964625 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a41a-d3ee-4047-88cc-6bcb0b427f7f None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:20.966024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 490/971] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:20.972074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b42a-9053-4037-a742-5f5ba354e506 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:20.972876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b42a-9053-4037-a742-5f5ba354e506 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:20.973321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b42a-9053-4037-a742-5f5ba354e506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:21.031944 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-a997b42a-9053-4037-a742-5f5ba354e506 None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:21.034012 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a997b42a-9053-4037-a742-5f5ba354e506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:21.229105 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 482/972] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:14:20 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:24.915936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=2 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:14:26.024250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbab7c-8fde-44cc-9e5d-4b93faffe4e4 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:26.024859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbab7c-8fde-44cc-9e5d-4b93faffe4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:26.024859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbab7c-8fde-44cc-9e5d-4b93faffe4e4 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:26.026248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 491/973] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:26.032037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9d39-4583-4127-adb2-98738adfaadb None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:26.032470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9d39-4583-4127-adb2-98738adfaadb None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:26.032774 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9d39-4583-4127-adb2-98738adfaadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:26.053977 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-427c9d39-4583-4127-adb2-98738adfaadb None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:26.055332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-427c9d39-4583-4127-adb2-98738adfaadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:26.064832 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 483/974] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:14:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:27.381605 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de347f4c-7b73-4564-b1cc-1e3b691f0c1e None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:27.382174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de347f4c-7b73-4564-b1cc-1e3b691f0c1e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:27.382174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de347f4c-7b73-4564-b1cc-1e3b691f0c1e None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:27.383874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 492/975] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:27.389013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5903-ab7a-4998-99c6-3bd3cc2139d4 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:27.389469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5903-ab7a-4998-99c6-3bd3cc2139d4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:27.389580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da5903-ab7a-4998-99c6-3bd3cc2139d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:27.410429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-92da5903-ab7a-4998-99c6-3bd3cc2139d4 None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:27.411616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-92da5903-ab7a-4998-99c6-3bd3cc2139d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:27.420811 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 484/976] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:14:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:31.839140 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeb228-86fc-4eb4-91cd-4f01c29d2bc0 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:31.839740 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeb228-86fc-4eb4-91cd-4f01c29d2bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:31.839740 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeb228-86fc-4eb4-91cd-4f01c29d2bc0 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:31.841314 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 493/977] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:31.848217 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf743-57f0-4921-8cda-22c13989ba43 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:31.848769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf743-57f0-4921-8cda-22c13989ba43 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:31.849052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf743-57f0-4921-8cda-22c13989ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:31.871294 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-4eabf743-57f0-4921-8cda-22c13989ba43 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:31.872511 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-4eabf743-57f0-4921-8cda-22c13989ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:31.881204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 485/978] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:14:31.940045 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef942e-f21c-409d-b223-9393e20e610b None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:31.940633 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef942e-f21c-409d-b223-9393e20e610b None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:31.941253 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef942e-f21c-409d-b223-9393e20e610b None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:31.943128 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 494/979] 10.222.0.71 () {54 vars in 962 bytes} [Wed Jul 27 19:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:31.952699 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee5c7-87e5-4ce4-95cd-10463c176433 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:31.953212 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee5c7-87e5-4ce4-95cd-10463c176433 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:31.953695 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee5c7-87e5-4ce4-95cd-10463c176433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:32.009942 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-cc3ee5c7-87e5-4ce4-95cd-10463c176433 None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:32.011167 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-cc3ee5c7-87e5-4ce4-95cd-10463c176433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:32.097515 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:14:32.105491 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 486/980] 10.222.0.71 () {58 vars in 1059 bytes} [Wed Jul 27 19:14:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:32.113590 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef942e-f21c-409d-b223-9393e20e610b None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:32.128143 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef942e-f21c-409d-b223-9393e20e610b None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:32.134992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e2ea-0f7b-46fa-97be-d38b08fffed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:32.135689 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e2ea-0f7b-46fa-97be-d38b08fffed1 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:32.136205 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e2ea-0f7b-46fa-97be-d38b08fffed1 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:32.136549 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e2ea-0f7b-46fa-97be-d38b08fffed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:32.147346 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e2ea-0f7b-46fa-97be-d38b08fffed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:32.149285 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e2ea-0f7b-46fa-97be-d38b08fffed1 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:32.162596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 495/981] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:34.876927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862b8f-5043-4342-a194-8d6b9df34d6d None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:34.878350 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862b8f-5043-4342-a194-8d6b9df34d6d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:34.878350 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862b8f-5043-4342-a194-8d6b9df34d6d None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:34.880179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 487/982] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:34.886332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e548150-a56b-484f-83b7-ace8d2712610 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:34.887168 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e548150-a56b-484f-83b7-ace8d2712610 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:34.887168 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e548150-a56b-484f-83b7-ace8d2712610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:34.911988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-1e548150-a56b-484f-83b7-ace8d2712610 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:34.914240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-1e548150-a56b-484f-83b7-ace8d2712610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:34.929717 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 496/983] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:34.981604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e862b8f-5043-4342-a194-8d6b9df34d6d None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:34.997204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e862b8f-5043-4342-a194-8d6b9df34d6d None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:35.009380 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf039a8c-f53f-48e7-a214-ee5c140a917b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:35.010065 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf039a8c-f53f-48e7-a214-ee5c140a917b service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:35.010344 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf039a8c-f53f-48e7-a214-ee5c140a917b service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:35.010794 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf039a8c-f53f-48e7-a214-ee5c140a917b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:35.023305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf039a8c-f53f-48e7-a214-ee5c140a917b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:35.025052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf039a8c-f53f-48e7-a214-ee5c140a917b service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:35.036822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 488/984] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:14:37.698089 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddf7a-4cfd-4a18-a832-bb651deb2e67 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:37.698621 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddf7a-4cfd-4a18-a832-bb651deb2e67 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:37.698621 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddf7a-4cfd-4a18-a832-bb651deb2e67 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:37.699856 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 497/985] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:37.704908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832dde-207c-4ade-9366-e1d82cd5fd22 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:37.705445 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832dde-207c-4ade-9366-e1d82cd5fd22 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:37.705609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832dde-207c-4ade-9366-e1d82cd5fd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:37.724602 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-f5832dde-207c-4ade-9366-e1d82cd5fd22 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:37.725919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f5832dde-207c-4ade-9366-e1d82cd5fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:37.733624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 489/986] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:37.782516 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37588-31d0-4f74-9dc2-ac0ad1b97052 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:37.782794 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37588-31d0-4f74-9dc2-ac0ad1b97052 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:37.783063 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37588-31d0-4f74-9dc2-ac0ad1b97052 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:37.785007 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 498/987] 10.222.0.71 () {54 vars in 962 bytes} [Wed Jul 27 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:37.790432 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d1919-ffdd-4ca1-a0b4-5e0f2f5c67d0 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:37.790723 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d1919-ffdd-4ca1-a0b4-5e0f2f5c67d0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:37.791002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d1919-ffdd-4ca1-a0b4-5e0f2f5c67d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:37.811743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-204d1919-ffdd-4ca1-a0b4-5e0f2f5c67d0 None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:37.812937 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-204d1919-ffdd-4ca1-a0b4-5e0f2f5c67d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:37.822603 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 490/988] 10.222.0.71 () {58 vars in 1059 bytes} [Wed Jul 27 19:14:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:37.831008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e37588-31d0-4f74-9dc2-ac0ad1b97052 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:37.844361 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e37588-31d0-4f74-9dc2-ac0ad1b97052 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:37.850626 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8de4c-29a7-4adf-bc5f-a9574fce00df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:37.851216 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8de4c-29a7-4adf-bc5f-a9574fce00df service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:37.851490 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8de4c-29a7-4adf-bc5f-a9574fce00df service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:37.851761 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8de4c-29a7-4adf-bc5f-a9574fce00df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:37.860975 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8de4c-29a7-4adf-bc5f-a9574fce00df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:37.862668 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8de4c-29a7-4adf-bc5f-a9574fce00df service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:37.873180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 499/989] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:40.399855 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc9cb-6cf7-43c8-a6a8-f278a6d34c81 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:40.400423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc9cb-6cf7-43c8-a6a8-f278a6d34c81 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:40.400423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc9cb-6cf7-43c8-a6a8-f278a6d34c81 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:40.401757 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 491/990] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:40.407486 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179fcf4-0816-4cd0-b380-fb44bc55f5c4 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:40.408848 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179fcf4-0816-4cd0-b380-fb44bc55f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:40.408848 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179fcf4-0816-4cd0-b380-fb44bc55f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:40.428760 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-b179fcf4-0816-4cd0-b380-fb44bc55f5c4 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:40.429992 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-b179fcf4-0816-4cd0-b380-fb44bc55f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:40.438652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 500/991] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:40.500342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dc9cb-6cf7-43c8-a6a8-f278a6d34c81 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:40.535609 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dc9cb-6cf7-43c8-a6a8-f278a6d34c81 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:40.545516 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3208fa-908e-489c-b259-a4ea81d76254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:40.547939 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3208fa-908e-489c-b259-a4ea81d76254 service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:40.548407 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3208fa-908e-489c-b259-a4ea81d76254 service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:40.548851 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3208fa-908e-489c-b259-a4ea81d76254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:40.564982 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3208fa-908e-489c-b259-a4ea81d76254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:40.567437 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3208fa-908e-489c-b259-a4ea81d76254 service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:40.588095 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 492/992] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:42.844052 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723cb3-2727-47fb-ac14-2bb5c75de8e0 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:42.845538 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723cb3-2727-47fb-ac14-2bb5c75de8e0 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:42.846432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723cb3-2727-47fb-ac14-2bb5c75de8e0 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:42.858272 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa913f7-7c40-4c98-9389-52766d5d44b8 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:42.859633 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa913f7-7c40-4c98-9389-52766d5d44b8 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:42.860411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa913f7-7c40-4c98-9389-52766d5d44b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:42.863816 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 501/993] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:42 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:42.905430 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-bfa913f7-7c40-4c98-9389-52766d5d44b8 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:42.908482 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-bfa913f7-7c40-4c98-9389-52766d5d44b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:42.941698 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 493/994] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:43.219752 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bbb3-f467-4e6e-9ca5-f4748320f583 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:43.221416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bbb3-f467-4e6e-9ca5-f4748320f583 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:43.222358 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bbb3-f467-4e6e-9ca5-f4748320f583 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:43.224439 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 502/995] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:43.231086 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beac8cf-e1ed-48d5-861b-0df1491a5627 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:43.231368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beac8cf-e1ed-48d5-861b-0df1491a5627 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:43.231824 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beac8cf-e1ed-48d5-861b-0df1491a5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:43.256516 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-2beac8cf-e1ed-48d5-861b-0df1491a5627 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:43.257528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-2beac8cf-e1ed-48d5-861b-0df1491a5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:43.270995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 494/996] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:43.330883 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318bbb3-f467-4e6e-9ca5-f4748320f583 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:43.356388 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318bbb3-f467-4e6e-9ca5-f4748320f583 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:43.363618 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:43.364345 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:43.364701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:43.365069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:43.367657 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbd15-e9a3-4096-9433-c99422218755 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:43.368088 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbd15-e9a3-4096-9433-c99422218755 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:43.368383 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbd15-e9a3-4096-9433-c99422218755 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:43.370378 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 495/997] 10.222.0.71 () {54 vars in 964 bytes} [Wed Jul 27 19:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:43.377733 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:43.378292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4005-809e-4d58-a71e-e0b6040142b6 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:43.378934 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4005-809e-4d58-a71e-e0b6040142b6 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:43.379528 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4005-809e-4d58-a71e-e0b6040142b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:43.380233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:43.394771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 503/998] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:14:43.428041 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e08e4005-809e-4d58-a71e-e0b6040142b6 None None] MFA Rules not processed for user `7605bd73b8204acba28a144a64d5eee7`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:43.429854 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e08e4005-809e-4d58-a71e-e0b6040142b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:43.525843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 496/999] 10.222.0.71 () {58 vars in 1061 bytes} [Wed Jul 27 19:14:43 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:43.539741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:43.557456 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5633cd-28bc-4153-a89b-60beeb9fc493 service nova] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:43.564343 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd379cb-057e-4523-a1e0-3357d4e49283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7605bd73b8204acba28a144a64d5eee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:43.567153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd379cb-057e-4523-a1e0-3357d4e49283 service cinder] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:43.567650 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd379cb-057e-4523-a1e0-3357d4e49283 service cinder] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:43.568134 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd379cb-057e-4523-a1e0-3357d4e49283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:43.586741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd379cb-057e-4523-a1e0-3357d4e49283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:43.589529 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd379cb-057e-4523-a1e0-3357d4e49283 service cinder] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:43.610667 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 504/1000] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:45.844483 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26d9d-f85e-4521-8aa9-16736fc332ad None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:45.844992 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26d9d-f85e-4521-8aa9-16736fc332ad None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:45.845081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26d9d-f85e-4521-8aa9-16736fc332ad None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:45.846996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 497/1001] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:45.853243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006744d-e888-4d0f-bdf5-ab795a08165f None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:45.853758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006744d-e888-4d0f-bdf5-ab795a08165f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:45.853923 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006744d-e888-4d0f-bdf5-ab795a08165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:45.875055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-1006744d-e888-4d0f-bdf5-ab795a08165f None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:45.876263 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-1006744d-e888-4d0f-bdf5-ab795a08165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:45.884557 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 505/1002] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:45.931950 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26d9d-f85e-4521-8aa9-16736fc332ad None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:45.946379 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26d9d-f85e-4521-8aa9-16736fc332ad None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:45.951718 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877c124-dbf1-4054-90b9-4fb3a403c454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:45.952351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877c124-dbf1-4054-90b9-4fb3a403c454 service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:45.953137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877c124-dbf1-4054-90b9-4fb3a403c454 service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:45.953137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877c124-dbf1-4054-90b9-4fb3a403c454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:45.963430 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877c124-dbf1-4054-90b9-4fb3a403c454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:45.965173 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877c124-dbf1-4054-90b9-4fb3a403c454 service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:45.976299 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 498/1003] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:48.324036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583a67-70bb-4131-aeac-5091e959204a None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:48.324629 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583a67-70bb-4131-aeac-5091e959204a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:48.324955 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583a67-70bb-4131-aeac-5091e959204a None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:48.326488 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 506/1004] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:48.333048 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1af07-02cc-4f5a-8c14-fd210c4c1798 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:48.333535 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1af07-02cc-4f5a-8c14-fd210c4c1798 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:48.333614 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1af07-02cc-4f5a-8c14-fd210c4c1798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:48.353807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-27b1af07-02cc-4f5a-8c14-fd210c4c1798 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:48.355014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-27b1af07-02cc-4f5a-8c14-fd210c4c1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:48.366135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 499/1005] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:14:48.406930 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583a67-70bb-4131-aeac-5091e959204a None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:48.420685 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583a67-70bb-4131-aeac-5091e959204a None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:48.428783 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ae84d-b75d-4ae1-a3f2-408f19567a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:48.430123 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae84d-b75d-4ae1-a3f2-408f19567a09 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:48.430710 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae84d-b75d-4ae1-a3f2-408f19567a09 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:48.431310 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae84d-b75d-4ae1-a3f2-408f19567a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:48.443600 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ae84d-b75d-4ae1-a3f2-408f19567a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:48.445299 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ae84d-b75d-4ae1-a3f2-408f19567a09 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:48.456062 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 507/1006] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:50.764370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0812-2193-4d43-b200-d4b05fbf0703 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:50.764899 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0812-2193-4d43-b200-d4b05fbf0703 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:50.764899 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0812-2193-4d43-b200-d4b05fbf0703 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:50.766311 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 500/1007] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:50.772654 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45254b-941d-4c57-a17f-19f8692fd85b None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:50.773575 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45254b-941d-4c57-a17f-19f8692fd85b None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:50.773966 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45254b-941d-4c57-a17f-19f8692fd85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:50.793999 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-3f45254b-941d-4c57-a17f-19f8692fd85b None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:50.795325 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-3f45254b-941d-4c57-a17f-19f8692fd85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:50.809690 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 508/1008] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:50.850542 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a0812-2193-4d43-b200-d4b05fbf0703 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:50.866795 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a0812-2193-4d43-b200-d4b05fbf0703 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:50.872285 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911f8fe-0b44-423d-a068-38543535c066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:50.872907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911f8fe-0b44-423d-a068-38543535c066 service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:50.873438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911f8fe-0b44-423d-a068-38543535c066 service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:50.874698 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911f8fe-0b44-423d-a068-38543535c066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:50.887401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911f8fe-0b44-423d-a068-38543535c066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:50.889017 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911f8fe-0b44-423d-a068-38543535c066 service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:50.900391 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 501/1009] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:53.369299 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d43e1-5ce2-4296-a50f-9d74c435e4be None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:53.369863 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d43e1-5ce2-4296-a50f-9d74c435e4be None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:53.369863 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d43e1-5ce2-4296-a50f-9d74c435e4be None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:53.371449 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 509/1010] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:14:53.378204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2f292-c9ee-49be-834e-0cfe481d6e46 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:53.378890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2f292-c9ee-49be-834e-0cfe481d6e46 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:53.378890 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2f292-c9ee-49be-834e-0cfe481d6e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:53.399861 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-9bd2f292-c9ee-49be-834e-0cfe481d6e46 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:53.401097 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-9bd2f292-c9ee-49be-834e-0cfe481d6e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:53.409561 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 502/1011] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:53.468364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d43e1-5ce2-4296-a50f-9d74c435e4be None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:53.492898 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d43e1-5ce2-4296-a50f-9d74c435e4be None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:53.514748 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc0a03-ab4a-46f5-a2f4-a8cee649eeba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:53.515833 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0a03-ab4a-46f5-a2f4-a8cee649eeba service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:53.516347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0a03-ab4a-46f5-a2f4-a8cee649eeba service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:53.516770 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0a03-ab4a-46f5-a2f4-a8cee649eeba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:53.531398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc0a03-ab4a-46f5-a2f4-a8cee649eeba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:53.535039 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc0a03-ab4a-46f5-a2f4-a8cee649eeba service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:53.552128 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 510/1012] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:56.331989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f119-b827-4f55-9e7e-5186b03c19e2 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:56.332945 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f119-b827-4f55-9e7e-5186b03c19e2 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:56.332945 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f119-b827-4f55-9e7e-5186b03c19e2 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:56.334772 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 503/1013] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:56.342166 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bfd3f-0926-4ccc-9cf5-f03c0fd633d2 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:56.342747 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bfd3f-0926-4ccc-9cf5-f03c0fd633d2 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:56.343062 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bfd3f-0926-4ccc-9cf5-f03c0fd633d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:56.352570 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=49 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:14:56.367496 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-876bfd3f-0926-4ccc-9cf5-f03c0fd633d2 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:56.370335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-876bfd3f-0926-4ccc-9cf5-f03c0fd633d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:56.379850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 511/1014] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:56.440656 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f119-b827-4f55-9e7e-5186b03c19e2 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:56.457176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f119-b827-4f55-9e7e-5186b03c19e2 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:56.465028 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb17c-762c-4164-82e3-dfb0e4245e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:56.466009 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb17c-762c-4164-82e3-dfb0e4245e6c service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:56.466411 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb17c-762c-4164-82e3-dfb0e4245e6c service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:56.466815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb17c-762c-4164-82e3-dfb0e4245e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:56.480783 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb17c-762c-4164-82e3-dfb0e4245e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:56.482480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb17c-762c-4164-82e3-dfb0e4245e6c service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:56.495584 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 504/1015] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:59.111027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7efe24-dc84-4c93-a7a7-e9e6c6b3e84d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:59.111931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7efe24-dc84-4c93-a7a7-e9e6c6b3e84d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:59.112218 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7efe24-dc84-4c93-a7a7-e9e6c6b3e84d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:59.113607 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 512/1016] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:59.119569 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385c5e9-e794-4411-8be4-f5c9cff4667b None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:59.120194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385c5e9-e794-4411-8be4-f5c9cff4667b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:59.120194 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385c5e9-e794-4411-8be4-f5c9cff4667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:59.148562 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-f385c5e9-e794-4411-8be4-f5c9cff4667b None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:59.150366 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f385c5e9-e794-4411-8be4-f5c9cff4667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:59.160714 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 505/1017] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:59.210586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7efe24-dc84-4c93-a7a7-e9e6c6b3e84d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:14:59.226095 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7efe24-dc84-4c93-a7a7-e9e6c6b3e84d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:14:59.231194 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6e421-1423-4e7d-92a8-cb6ffe53057d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:14:59.231856 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6e421-1423-4e7d-92a8-cb6ffe53057d service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:59.232124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6e421-1423-4e7d-92a8-cb6ffe53057d service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:59.232392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6e421-1423-4e7d-92a8-cb6ffe53057d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:59.241238 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6e421-1423-4e7d-92a8-cb6ffe53057d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:14:59.242902 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6e421-1423-4e7d-92a8-cb6ffe53057d service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:14:59.254503 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 513/1018] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:14:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:14:59.784796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bae2-fb06-4539-9597-a87a974ef79a None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:59.785087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bae2-fb06-4539-9597-a87a974ef79a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:59.785469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bae2-fb06-4539-9597-a87a974ef79a None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:59.786943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 506/1019] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:59.792719 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45053e0a-0620-46aa-bba7-c2f99beecd31 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:59.792986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45053e0a-0620-46aa-bba7-c2f99beecd31 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:59.793261 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45053e0a-0620-46aa-bba7-c2f99beecd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:59.817433 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-45053e0a-0620-46aa-bba7-c2f99beecd31 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:59.818682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-45053e0a-0620-46aa-bba7-c2f99beecd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:59.828395 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 514/1020] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:14:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:14:59.887152 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42093ba3-9aa9-447f-b80f-3f2021cb6c99 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:59.887436 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42093ba3-9aa9-447f-b80f-3f2021cb6c99 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:59.887718 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42093ba3-9aa9-447f-b80f-3f2021cb6c99 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:59.889217 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 507/1021] 10.222.0.71 () {54 vars in 966 bytes} [Wed Jul 27 19:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:14:59.894372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb79e2-7d1b-4ec9-bba4-87e3f7042fe8 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:14:59.894589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb79e2-7d1b-4ec9-bba4-87e3f7042fe8 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:14:59.894860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb79e2-7d1b-4ec9-bba4-87e3f7042fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:14:59.936110 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-0dfb79e2-7d1b-4ec9-bba4-87e3f7042fe8 None None] MFA Rules not processed for user `0421ec636a1545329ad46308ef451145`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:14:59.937312 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-0dfb79e2-7d1b-4ec9-bba4-87e3f7042fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:14:59.999403 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 515/1022] 10.222.0.71 () {58 vars in 1063 bytes} [Wed Jul 27 19:14:59 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:00.007763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42093ba3-9aa9-447f-b80f-3f2021cb6c99 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:00.018518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42093ba3-9aa9-447f-b80f-3f2021cb6c99 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:00.022090 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2eaa-ed14-4a93-8f8d-d0bf49b72ff8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0421ec636a1545329ad46308ef451145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:00.022717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2eaa-ed14-4a93-8f8d-d0bf49b72ff8 service glance] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:00.022998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2eaa-ed14-4a93-8f8d-d0bf49b72ff8 service glance] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:00.023273 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2eaa-ed14-4a93-8f8d-d0bf49b72ff8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:00.034121 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2eaa-ed14-4a93-8f8d-d0bf49b72ff8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:00.035564 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2eaa-ed14-4a93-8f8d-d0bf49b72ff8 service glance] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:00.046021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 508/1023] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:15:01.625219 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d74d6-a3dc-4128-919d-8f009dc343ea None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:01.625974 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d74d6-a3dc-4128-919d-8f009dc343ea None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:01.625974 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d74d6-a3dc-4128-919d-8f009dc343ea None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:01.627914 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 516/1024] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:01.634037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d184c-a1d8-40e7-ac50-b3511d05992d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:01.634613 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d184c-a1d8-40e7-ac50-b3511d05992d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:01.634613 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d184c-a1d8-40e7-ac50-b3511d05992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:01.664540 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-aa2d184c-a1d8-40e7-ac50-b3511d05992d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:01.665816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-aa2d184c-a1d8-40e7-ac50-b3511d05992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:01.674577 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 509/1025] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:15:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:01.730538 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d74d6-a3dc-4128-919d-8f009dc343ea None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:01.749988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d74d6-a3dc-4128-919d-8f009dc343ea None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:01.755608 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63cd17-a9c8-4066-ae13-ee181e859896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:01.756251 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63cd17-a9c8-4066-ae13-ee181e859896 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:01.756527 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63cd17-a9c8-4066-ae13-ee181e859896 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:01.756803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63cd17-a9c8-4066-ae13-ee181e859896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:01.765869 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63cd17-a9c8-4066-ae13-ee181e859896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:01.767522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63cd17-a9c8-4066-ae13-ee181e859896 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:01.778578 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 517/1026] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:11.648875 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=94 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:15:11.773379 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=50 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:15:15.659433 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084107e-bff9-4de4-9c0d-25614eec79d6 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:15.660197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084107e-bff9-4de4-9c0d-25614eec79d6 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:15.660197 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084107e-bff9-4de4-9c0d-25614eec79d6 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:15.661361 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 510/1027] 10.222.0.71 () {54 vars in 918 bytes} [Wed Jul 27 19:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:15:15.666832 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dee88-7ffb-4f73-84aa-5942ff373a21 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:15.667410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dee88-7ffb-4f73-84aa-5942ff373a21 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:15.667410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dee88-7ffb-4f73-84aa-5942ff373a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:15.688364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-7f8dee88-7ffb-4f73-84aa-5942ff373a21 None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:15.690408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-7f8dee88-7ffb-4f73-84aa-5942ff373a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:15.699280 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 518/1028] 10.222.0.71 () {58 vars in 1015 bytes} [Wed Jul 27 19:15:15 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:15.714808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab318234-b0a5-4b82-be03-94b1a9367652 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:15.715093 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab318234-b0a5-4b82-be03-94b1a9367652 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:15.715369 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab318234-b0a5-4b82-be03-94b1a9367652 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:15.716736 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 511/1029] 10.222.0.71 () {54 vars in 918 bytes} [Wed Jul 27 19:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:15.723641 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383b35e-acc6-4d6a-909c-1bc74dd04bb8 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:15.723928 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383b35e-acc6-4d6a-909c-1bc74dd04bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:15.724211 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383b35e-acc6-4d6a-909c-1bc74dd04bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:15.745119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-3383b35e-acc6-4d6a-909c-1bc74dd04bb8 None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:15.746652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-3383b35e-acc6-4d6a-909c-1bc74dd04bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:15.756127 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 519/1030] 10.222.0.71 () {58 vars in 1015 bytes} [Wed Jul 27 19:15:15 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:18.531983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3c572-c32f-45db-8b94-a52fdadeca43 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:18.533130 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3c572-c32f-45db-8b94-a52fdadeca43 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:18.533130 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3c572-c32f-45db-8b94-a52fdadeca43 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:18.533895 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 512/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:18.539450 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7362-2fdb-41f9-8d2e-015d4bfba552 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:18.539926 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7362-2fdb-41f9-8d2e-015d4bfba552 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:18.540021 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7362-2fdb-41f9-8d2e-015d4bfba552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:18.558582 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-e08b7362-2fdb-41f9-8d2e-015d4bfba552 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:18.559775 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-e08b7362-2fdb-41f9-8d2e-015d4bfba552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:18.568240 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 520/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:18.612058 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3c572-c32f-45db-8b94-a52fdadeca43 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:18.625870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3c572-c32f-45db-8b94-a52fdadeca43 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:18.631680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331fa46-b2bf-4d48-ae6e-a2087bdccee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:18.632292 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331fa46-b2bf-4d48-ae6e-a2087bdccee9 service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:18.632572 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331fa46-b2bf-4d48-ae6e-a2087bdccee9 service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:18.632849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331fa46-b2bf-4d48-ae6e-a2087bdccee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:18.641249 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331fa46-b2bf-4d48-ae6e-a2087bdccee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:18.643556 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331fa46-b2bf-4d48-ae6e-a2087bdccee9 service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:18.653169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 513/1033] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:19.623243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76564-a5ab-4676-a122-436a3823c071 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:19.623841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76564-a5ab-4676-a122-436a3823c071 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:19.623841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76564-a5ab-4676-a122-436a3823c071 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:19.625146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 521/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:19.631222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843bd1-7a7b-453d-a97a-8c7e481a7616 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:19.631743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843bd1-7a7b-453d-a97a-8c7e481a7616 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:19.631837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843bd1-7a7b-453d-a97a-8c7e481a7616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:19.651637 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-0e843bd1-7a7b-453d-a97a-8c7e481a7616 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:19.652876 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-0e843bd1-7a7b-453d-a97a-8c7e481a7616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:19.667253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 514/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:19.904839 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76564-a5ab-4676-a122-436a3823c071 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:19.918204 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76564-a5ab-4676-a122-436a3823c071 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:19.923585 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e948c0-6f5c-4008-b19c-25e38f661f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:19.924199 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e948c0-6f5c-4008-b19c-25e38f661f2c service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:19.924473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e948c0-6f5c-4008-b19c-25e38f661f2c service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:19.924742 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e948c0-6f5c-4008-b19c-25e38f661f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:19.933481 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e948c0-6f5c-4008-b19c-25e38f661f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:19.935124 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e948c0-6f5c-4008-b19c-25e38f661f2c service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:19.947201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 522/1036] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:20.881796 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b523616-6b8a-4cd9-8daa-5b0fbc87f7f4 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:20.882376 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b523616-6b8a-4cd9-8daa-5b0fbc87f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:20.882376 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b523616-6b8a-4cd9-8daa-5b0fbc87f7f4 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:20.883705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 515/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:20.889094 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d5235-f532-4a32-9295-137229331a27 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:20.889622 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d5235-f532-4a32-9295-137229331a27 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:20.889622 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d5235-f532-4a32-9295-137229331a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:20.910665 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-150d5235-f532-4a32-9295-137229331a27 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:20.911894 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-150d5235-f532-4a32-9295-137229331a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:20.919925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 523/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:21.081352 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b523616-6b8a-4cd9-8daa-5b0fbc87f7f4 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:21.096824 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b523616-6b8a-4cd9-8daa-5b0fbc87f7f4 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:21.102177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f6f62-3e9a-4e7e-97d7-7e524d4ccea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:21.102816 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f6f62-3e9a-4e7e-97d7-7e524d4ccea5 service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:21.103098 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f6f62-3e9a-4e7e-97d7-7e524d4ccea5 service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:21.103373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f6f62-3e9a-4e7e-97d7-7e524d4ccea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:21.113525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f6f62-3e9a-4e7e-97d7-7e524d4ccea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:21.115175 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f6f62-3e9a-4e7e-97d7-7e524d4ccea5 service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:21.125571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 516/1039] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:22.064406 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc16eb-b29d-4ea1-8d13-81ab1363a37d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:22.065015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc16eb-b29d-4ea1-8d13-81ab1363a37d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:22.065015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc16eb-b29d-4ea1-8d13-81ab1363a37d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:22.066543 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 524/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:22.073332 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221dc71-e4a2-411e-846d-49729e498b6c None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:22.073893 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221dc71-e4a2-411e-846d-49729e498b6c None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:22.074016 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221dc71-e4a2-411e-846d-49729e498b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:22.096062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-f221dc71-e4a2-411e-846d-49729e498b6c None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:22.097302 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f221dc71-e4a2-411e-846d-49729e498b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:22.105361 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 517/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:22.264832 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc16eb-b29d-4ea1-8d13-81ab1363a37d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:22.279444 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc16eb-b29d-4ea1-8d13-81ab1363a37d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:22.284704 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa90a1-4daf-4f17-850e-a6399d48f574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:22.285330 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa90a1-4daf-4f17-850e-a6399d48f574 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:22.285605 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa90a1-4daf-4f17-850e-a6399d48f574 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:22.285910 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa90a1-4daf-4f17-850e-a6399d48f574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:22.294873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa90a1-4daf-4f17-850e-a6399d48f574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:22.296459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa90a1-4daf-4f17-850e-a6399d48f574 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:22.307001 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 525/1042] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:23.193630 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65a188-a5bf-4855-8100-cc6b63d330a2 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:23.194223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65a188-a5bf-4855-8100-cc6b63d330a2 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:23.194223 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65a188-a5bf-4855-8100-cc6b63d330a2 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:23.195560 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 518/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:23.201080 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58391f8-e991-451e-b818-45fa84c5215e None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:23.201569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58391f8-e991-451e-b818-45fa84c5215e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:23.201803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58391f8-e991-451e-b818-45fa84c5215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:23.223738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-b58391f8-e991-451e-b818-45fa84c5215e None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:23.225025 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-b58391f8-e991-451e-b818-45fa84c5215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:23.239066 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 526/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:23.396287 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65a188-a5bf-4855-8100-cc6b63d330a2 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:23.410210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65a188-a5bf-4855-8100-cc6b63d330a2 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:23.415116 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd2eb6-7395-4319-9388-f8355544f279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:23.415724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2eb6-7395-4319-9388-f8355544f279 service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:23.416004 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2eb6-7395-4319-9388-f8355544f279 service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:23.416279 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2eb6-7395-4319-9388-f8355544f279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:23.425466 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd2eb6-7395-4319-9388-f8355544f279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:23.427101 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd2eb6-7395-4319-9388-f8355544f279 service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:23.436788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 519/1045] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:24.255295 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32acd-d0ba-4fc2-a5dc-77a308b8edb7 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:24.255915 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32acd-d0ba-4fc2-a5dc-77a308b8edb7 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:24.255915 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32acd-d0ba-4fc2-a5dc-77a308b8edb7 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:24.257332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 527/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:24.263003 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9f12-4042-41f4-9007-fc1414108e2d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:24.263492 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9f12-4042-41f4-9007-fc1414108e2d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:24.263605 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9f12-4042-41f4-9007-fc1414108e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:24.284005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-dd8b9f12-4042-41f4-9007-fc1414108e2d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:24.285220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-dd8b9f12-4042-41f4-9007-fc1414108e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:24.293826 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 520/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:24.454308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32acd-d0ba-4fc2-a5dc-77a308b8edb7 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:24.468536 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32acd-d0ba-4fc2-a5dc-77a308b8edb7 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:24.474108 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4de164-c444-426a-b689-909566effd7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:24.474729 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de164-c444-426a-b689-909566effd7c service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:24.475010 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de164-c444-426a-b689-909566effd7c service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:24.475284 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4de164-c444-426a-b689-909566effd7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:24.484132 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4de164-c444-426a-b689-909566effd7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:24.486369 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4de164-c444-426a-b689-909566effd7c service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:24.496509 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 528/1048] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:25.322341 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22021-a8f0-499a-b1d0-7bf40a8b16ee None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:25.322879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22021-a8f0-499a-b1d0-7bf40a8b16ee None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:25.322879 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22021-a8f0-499a-b1d0-7bf40a8b16ee None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:25.324220 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 521/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:25.330439 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7978-c608-4173-8910-4ccb4e1d8161 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:25.331336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7978-c608-4173-8910-4ccb4e1d8161 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:25.331336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c7978-c608-4173-8910-4ccb4e1d8161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:25.351353 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-694c7978-c608-4173-8910-4ccb4e1d8161 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:25.352578 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-694c7978-c608-4173-8910-4ccb4e1d8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:25.361089 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 529/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:25.517359 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22021-a8f0-499a-b1d0-7bf40a8b16ee None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:25.532574 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22021-a8f0-499a-b1d0-7bf40a8b16ee None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:25.537780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab662-d2b7-4bac-a927-4b2d8f46bcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:25.538471 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab662-d2b7-4bac-a927-4b2d8f46bcab service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:25.538753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab662-d2b7-4bac-a927-4b2d8f46bcab service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:25.539024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab662-d2b7-4bac-a927-4b2d8f46bcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:25.548925 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ab662-d2b7-4bac-a927-4b2d8f46bcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:25.550656 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ab662-d2b7-4bac-a927-4b2d8f46bcab service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:25.560960 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 522/1051] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:26.379152 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c41d7-2d1e-4b78-bfef-ec6cafc47d1f None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:26.379951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c41d7-2d1e-4b78-bfef-ec6cafc47d1f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:26.379951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c41d7-2d1e-4b78-bfef-ec6cafc47d1f None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:26.381381 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 530/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:26.387323 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7647bc-218c-416b-9069-ad43169a1f58 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:26.387775 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7647bc-218c-416b-9069-ad43169a1f58 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:26.387913 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7647bc-218c-416b-9069-ad43169a1f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:26.409239 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-ee7647bc-218c-416b-9069-ad43169a1f58 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:26.410532 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-ee7647bc-218c-416b-9069-ad43169a1f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:26.418600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 523/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:26.580364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c41d7-2d1e-4b78-bfef-ec6cafc47d1f None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:26.593934 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c41d7-2d1e-4b78-bfef-ec6cafc47d1f None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:26.598850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c2daa-b9a8-44f4-ac9d-fb89ef3836ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:26.599453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2daa-b9a8-44f4-ac9d-fb89ef3836ed service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:26.599734 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2daa-b9a8-44f4-ac9d-fb89ef3836ed service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:26.600041 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2daa-b9a8-44f4-ac9d-fb89ef3836ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:26.608094 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c2daa-b9a8-44f4-ac9d-fb89ef3836ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:26.609682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c2daa-b9a8-44f4-ac9d-fb89ef3836ed service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:26.619609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 531/1054] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:27.435329 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994f75-2161-41c6-a4fe-ef4c2ba4a845 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:27.435886 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994f75-2161-41c6-a4fe-ef4c2ba4a845 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:27.435990 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994f75-2161-41c6-a4fe-ef4c2ba4a845 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:27.437273 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 524/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:27.443254 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61689ced-8e4f-4e40-993f-c0008a1f06e9 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:27.443716 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61689ced-8e4f-4e40-993f-c0008a1f06e9 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:27.443813 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61689ced-8e4f-4e40-993f-c0008a1f06e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:27.463441 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-61689ced-8e4f-4e40-993f-c0008a1f06e9 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:27.464630 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-61689ced-8e4f-4e40-993f-c0008a1f06e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:27.473040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 532/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:15:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:27.634064 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994f75-2161-41c6-a4fe-ef4c2ba4a845 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:27.649424 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994f75-2161-41c6-a4fe-ef4c2ba4a845 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:27.654369 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2584e0d-bc10-4444-ace3-c078fbf44bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:27.654983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584e0d-bc10-4444-ace3-c078fbf44bbe service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:27.655267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584e0d-bc10-4444-ace3-c078fbf44bbe service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:27.655536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584e0d-bc10-4444-ace3-c078fbf44bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:27.664362 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2584e0d-bc10-4444-ace3-c078fbf44bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:27.666007 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2584e0d-bc10-4444-ace3-c078fbf44bbe service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:27.676385 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 525/1057] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:29.846096 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee334ed-7f49-41b5-a823-2fd64bda4fbc None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:29.846727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee334ed-7f49-41b5-a823-2fd64bda4fbc None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:29.846727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee334ed-7f49-41b5-a823-2fd64bda4fbc None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:29.848001 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 533/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:29.853601 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92d9f-52cf-43f7-a4c4-6d7dd4afbe05 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:29.854081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92d9f-52cf-43f7-a4c4-6d7dd4afbe05 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:29.854178 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92d9f-52cf-43f7-a4c4-6d7dd4afbe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:29.873857 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-11f92d9f-52cf-43f7-a4c4-6d7dd4afbe05 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:29.875087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-11f92d9f-52cf-43f7-a4c4-6d7dd4afbe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:29.884143 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 526/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:29.924891 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee334ed-7f49-41b5-a823-2fd64bda4fbc None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:29.936139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee334ed-7f49-41b5-a823-2fd64bda4fbc None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:29.941056 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79d74-f9bb-40a3-8c0d-cf12f9a582b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:29.941743 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79d74-f9bb-40a3-8c0d-cf12f9a582b1 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:29.942028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79d74-f9bb-40a3-8c0d-cf12f9a582b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:29.942303 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79d74-f9bb-40a3-8c0d-cf12f9a582b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:29.952942 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e79d74-f9bb-40a3-8c0d-cf12f9a582b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:29.955243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e79d74-f9bb-40a3-8c0d-cf12f9a582b1 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:29.966246 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 534/1060] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:32.365506 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d4fb-9238-49a7-9cc3-ff163991ab8f None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:32.366085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d4fb-9238-49a7-9cc3-ff163991ab8f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:32.366085 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d4fb-9238-49a7-9cc3-ff163991ab8f None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:32.367429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 527/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:32.372872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a6c3-28df-421f-b09f-7fe426c49be0 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:32.373305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a6c3-28df-421f-b09f-7fe426c49be0 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:32.373399 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a6c3-28df-421f-b09f-7fe426c49be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:32.393429 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-3755a6c3-28df-421f-b09f-7fe426c49be0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:32.394652 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-3755a6c3-28df-421f-b09f-7fe426c49be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:32.402364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 535/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:32.443104 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d4fb-9238-49a7-9cc3-ff163991ab8f None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:32.454294 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d4fb-9238-49a7-9cc3-ff163991ab8f None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:32.457895 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71286b55-c8e9-4a6c-8cdf-9f004305e387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:32.458504 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286b55-c8e9-4a6c-8cdf-9f004305e387 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:32.458785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286b55-c8e9-4a6c-8cdf-9f004305e387 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:32.459057 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71286b55-c8e9-4a6c-8cdf-9f004305e387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:32.468145 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71286b55-c8e9-4a6c-8cdf-9f004305e387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:32.469579 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71286b55-c8e9-4a6c-8cdf-9f004305e387 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:32.479127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 528/1063] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:35.070604 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2695-c952-407a-87bb-eb82ea5ac3af None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:35.071139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2695-c952-407a-87bb-eb82ea5ac3af None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:35.071139 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2695-c952-407a-87bb-eb82ea5ac3af None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:35.072491 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 536/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:35.077603 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de292-79f0-407e-ace9-a35aaa563e25 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:35.078031 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de292-79f0-407e-ace9-a35aaa563e25 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:35.078183 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de292-79f0-407e-ace9-a35aaa563e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:35.097908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-2e9de292-79f0-407e-ace9-a35aaa563e25 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:35.099113 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-2e9de292-79f0-407e-ace9-a35aaa563e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:35.106918 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 529/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:35.147416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2695-c952-407a-87bb-eb82ea5ac3af None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:35.158121 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2695-c952-407a-87bb-eb82ea5ac3af None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:35.161913 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f40350-d20e-449f-8b84-c68526c689d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:35.162522 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40350-d20e-449f-8b84-c68526c689d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:35.162801 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40350-d20e-449f-8b84-c68526c689d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:35.163072 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40350-d20e-449f-8b84-c68526c689d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:35.172791 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f40350-d20e-449f-8b84-c68526c689d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:35.174275 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f40350-d20e-449f-8b84-c68526c689d0 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:35.185296 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 537/1066] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:37.633591 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1ddc8-d7c8-4320-8b0f-ca764e05f124 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:37.634231 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1ddc8-d7c8-4320-8b0f-ca764e05f124 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:37.634231 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1ddc8-d7c8-4320-8b0f-ca764e05f124 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:37.635522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 530/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:37.641837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2d4c-d004-4fe5-a9d9-7292bfe0da31 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:37.642873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2d4c-d004-4fe5-a9d9-7292bfe0da31 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:37.642873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2d4c-d004-4fe5-a9d9-7292bfe0da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:37.663814 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-dc0c2d4c-d004-4fe5-a9d9-7292bfe0da31 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:37.665065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-dc0c2d4c-d004-4fe5-a9d9-7292bfe0da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:37.673767 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 538/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:37.718422 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1ddc8-d7c8-4320-8b0f-ca764e05f124 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:37.730133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1ddc8-d7c8-4320-8b0f-ca764e05f124 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:37.733686 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f5cbd-adc6-4009-94b0-5deed0825b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:37.734327 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f5cbd-adc6-4009-94b0-5deed0825b2a service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:37.734611 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f5cbd-adc6-4009-94b0-5deed0825b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:37.734883 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f5cbd-adc6-4009-94b0-5deed0825b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:37.744858 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f5cbd-adc6-4009-94b0-5deed0825b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:37.746320 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f5cbd-adc6-4009-94b0-5deed0825b2a service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:37.756631 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 531/1069] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:40.249669 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc33f-bafb-45c1-9e6e-b38a52695543 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:40.250526 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc33f-bafb-45c1-9e6e-b38a52695543 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:40.250723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc33f-bafb-45c1-9e6e-b38a52695543 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:40.252569 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 539/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:40.258020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970ef39-6e59-4adb-8a0b-3e3b81001f8e None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:40.258442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970ef39-6e59-4adb-8a0b-3e3b81001f8e None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:40.258562 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970ef39-6e59-4adb-8a0b-3e3b81001f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:40.277948 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-c970ef39-6e59-4adb-8a0b-3e3b81001f8e None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:40.279139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-c970ef39-6e59-4adb-8a0b-3e3b81001f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:40.287420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 532/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:40.327059 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecc33f-bafb-45c1-9e6e-b38a52695543 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:40.337873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecc33f-bafb-45c1-9e6e-b38a52695543 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:40.341372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18fc0e-5f4b-4762-9ebc-14eafa02e83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:40.342020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18fc0e-5f4b-4762-9ebc-14eafa02e83f service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:40.342301 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18fc0e-5f4b-4762-9ebc-14eafa02e83f service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:40.342573 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18fc0e-5f4b-4762-9ebc-14eafa02e83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:40.353295 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18fc0e-5f4b-4762-9ebc-14eafa02e83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:40.354746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18fc0e-5f4b-4762-9ebc-14eafa02e83f service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:40.365228 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 540/1072] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:42.723167 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212608-7883-4c33-a8f8-e768d023543f None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:42.723751 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212608-7883-4c33-a8f8-e768d023543f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:42.723751 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212608-7883-4c33-a8f8-e768d023543f None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:42.725133 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 533/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:42.730520 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f78f6-0d42-4784-b2f8-29f37eb0dfb2 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:42.731119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f78f6-0d42-4784-b2f8-29f37eb0dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:42.731119 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f78f6-0d42-4784-b2f8-29f37eb0dfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:42.739877 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=70 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:15:42.753524 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-9a9f78f6-0d42-4784-b2f8-29f37eb0dfb2 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:42.754776 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9a9f78f6-0d42-4784-b2f8-29f37eb0dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:42.762789 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 541/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:42.802815 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212608-7883-4c33-a8f8-e768d023543f None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:42.808704 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=64 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:15:42.816166 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212608-7883-4c33-a8f8-e768d023543f None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:42.819680 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd6eee-f12a-4412-bc4e-823ef6522808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:42.820536 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6eee-f12a-4412-bc4e-823ef6522808 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:42.820767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6eee-f12a-4412-bc4e-823ef6522808 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:42.821005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6eee-f12a-4412-bc4e-823ef6522808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:42.831372 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd6eee-f12a-4412-bc4e-823ef6522808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:42.832899 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd6eee-f12a-4412-bc4e-823ef6522808 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:42.842716 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 534/1075] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:45.291720 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad81ee-b849-4908-ac44-39cba4f9ba36 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:45.292277 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad81ee-b849-4908-ac44-39cba4f9ba36 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:45.292277 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad81ee-b849-4908-ac44-39cba4f9ba36 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:45.293997 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 542/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:45.300717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812ce4-0b3d-4695-ba08-5a24b5e04b9a None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:45.301216 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812ce4-0b3d-4695-ba08-5a24b5e04b9a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:45.301330 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812ce4-0b3d-4695-ba08-5a24b5e04b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:45.322499 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-26812ce4-0b3d-4695-ba08-5a24b5e04b9a None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:45.323710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-26812ce4-0b3d-4695-ba08-5a24b5e04b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:45.332281 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 535/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:45.372595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad81ee-b849-4908-ac44-39cba4f9ba36 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:45.385408 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad81ee-b849-4908-ac44-39cba4f9ba36 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:45.389906 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ccd36-8fde-42d4-95be-2a1c77285664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:45.390583 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ccd36-8fde-42d4-95be-2a1c77285664 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:45.391088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ccd36-8fde-42d4-95be-2a1c77285664 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:45.391305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ccd36-8fde-42d4-95be-2a1c77285664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:45.401374 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ccd36-8fde-42d4-95be-2a1c77285664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:45.402871 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ccd36-8fde-42d4-95be-2a1c77285664 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:45.413469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 543/1078] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:47.872266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e08f-a446-4460-9e33-e8c33fc91696 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:47.872866 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e08f-a446-4460-9e33-e8c33fc91696 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:47.872866 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9e08f-a446-4460-9e33-e8c33fc91696 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:47.874184 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 536/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:47.879938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded27d-8c68-48df-a887-99ab3a474c63 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:47.880589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded27d-8c68-48df-a887-99ab3a474c63 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:47.880589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded27d-8c68-48df-a887-99ab3a474c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:47.901247 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-ceded27d-8c68-48df-a887-99ab3a474c63 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:47.902574 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-ceded27d-8c68-48df-a887-99ab3a474c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:47.912337 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 544/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:47.954792 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e08f-a446-4460-9e33-e8c33fc91696 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:47.966027 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9e08f-a446-4460-9e33-e8c33fc91696 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:47.971137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f258b-1c23-40e8-9094-e4bd969c3ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:47.971829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f258b-1c23-40e8-9094-e4bd969c3ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:47.972106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f258b-1c23-40e8-9094-e4bd969c3ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:47.972406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f258b-1c23-40e8-9094-e4bd969c3ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:47.982278 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f258b-1c23-40e8-9094-e4bd969c3ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:47.983833 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f258b-1c23-40e8-9094-e4bd969c3ed6 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:47.994753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 537/1081] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:50.358082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959350-fcc0-4329-9aa6-0aa8a80e1700 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:50.358668 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959350-fcc0-4329-9aa6-0aa8a80e1700 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:50.358668 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959350-fcc0-4329-9aa6-0aa8a80e1700 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:50.360655 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 545/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:15:50.366249 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10724e4-f765-44ac-b222-0667e18b5e46 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:50.366755 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10724e4-f765-44ac-b222-0667e18b5e46 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:50.366866 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10724e4-f765-44ac-b222-0667e18b5e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:50.387222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-e10724e4-f765-44ac-b222-0667e18b5e46 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:50.388430 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-e10724e4-f765-44ac-b222-0667e18b5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:50.396199 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 538/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:50.434310 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30959350-fcc0-4329-9aa6-0aa8a80e1700 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:50.445503 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30959350-fcc0-4329-9aa6-0aa8a80e1700 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:50.448900 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6d2b8-20d8-44cb-952d-ec91e01f63d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:50.449503 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d2b8-20d8-44cb-952d-ec91e01f63d6 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:50.449837 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d2b8-20d8-44cb-952d-ec91e01f63d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:50.450112 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d2b8-20d8-44cb-952d-ec91e01f63d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:50.459840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d2b8-20d8-44cb-952d-ec91e01f63d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:50.461302 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d2b8-20d8-44cb-952d-ec91e01f63d6 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:50.471195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 546/1084] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:52.839399 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d547-f06f-4034-8a6d-1b2ce87debf6 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:52.839983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d547-f06f-4034-8a6d-1b2ce87debf6 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:52.839983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d547-f06f-4034-8a6d-1b2ce87debf6 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:52.841296 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 539/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:15:52.847710 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac9034-0d2b-4b32-8c78-4a546e373ffb None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:52.848388 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac9034-0d2b-4b32-8c78-4a546e373ffb None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:52.848544 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac9034-0d2b-4b32-8c78-4a546e373ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:52.871916 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-f6ac9034-0d2b-4b32-8c78-4a546e373ffb None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:15:52.873170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-f6ac9034-0d2b-4b32-8c78-4a546e373ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:52.882648 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 547/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:15:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:15:52.923907 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d547-f06f-4034-8a6d-1b2ce87debf6 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:52.935349 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d547-f06f-4034-8a6d-1b2ce87debf6 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:52.940310 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1edd18-ac21-4e64-844c-3b521c61e22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:52.941022 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1edd18-ac21-4e64-844c-3b521c61e22a service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:52.941304 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1edd18-ac21-4e64-844c-3b521c61e22a service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:52.941576 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1edd18-ac21-4e64-844c-3b521c61e22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:52.951703 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1edd18-ac21-4e64-844c-3b521c61e22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:52.953422 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1edd18-ac21-4e64-844c-3b521c61e22a service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:52.965162 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 540/1087] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:16:02.866380 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=20 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:16:02.959728 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=23 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:16:17.470190 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200ac6-9843-4140-bf14-3bdf9eb1a001 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:17.470832 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200ac6-9843-4140-bf14-3bdf9eb1a001 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:17.470832 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200ac6-9843-4140-bf14-3bdf9eb1a001 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:17.472097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 548/1088] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:16:17.477517 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff02d-bbcc-4b4a-ab4c-19e086126c82 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:17.478038 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff02d-bbcc-4b4a-ab4c-19e086126c82 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:17.478202 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff02d-bbcc-4b4a-ab4c-19e086126c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:17.497911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-409ff02d-bbcc-4b4a-ab4c-19e086126c82 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:17.499108 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-409ff02d-bbcc-4b4a-ab4c-19e086126c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:17.507374 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 541/1089] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:16:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:16:17.557779 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605982e2-ca43-4daf-a247-d8811ae7caed None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:17.558062 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605982e2-ca43-4daf-a247-d8811ae7caed None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:17.558335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605982e2-ca43-4daf-a247-d8811ae7caed None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:17.559658 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 549/1090] 10.222.0.71 () {54 vars in 966 bytes} [Wed Jul 27 19:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:16:17.564881 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2af3c-be6c-4d58-b9e3-dfa6fd18bf5f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:17.565168 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2af3c-be6c-4d58-b9e3-dfa6fd18bf5f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:17.565443 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2af3c-be6c-4d58-b9e3-dfa6fd18bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:17.585383 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-45b2af3c-be6c-4d58-b9e3-dfa6fd18bf5f None None] MFA Rules not processed for user `0421ec636a1545329ad46308ef451145`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:17.586652 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-45b2af3c-be6c-4d58-b9e3-dfa6fd18bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:17.593989 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 542/1091] 10.222.0.71 () {58 vars in 1063 bytes} [Wed Jul 27 19:16:17 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:16:17.601329 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605982e2-ca43-4daf-a247-d8811ae7caed None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:17.613022 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605982e2-ca43-4daf-a247-d8811ae7caed None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:17.616644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99387bd-ee15-424a-9487-125034996907 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0421ec636a1545329ad46308ef451145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:17.617251 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99387bd-ee15-424a-9487-125034996907 service glance] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:17.617528 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99387bd-ee15-424a-9487-125034996907 service glance] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:17.617844 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99387bd-ee15-424a-9487-125034996907 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:17.628596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99387bd-ee15-424a-9487-125034996907 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:17.630065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99387bd-ee15-424a-9487-125034996907 service glance] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:17.640163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 550/1092] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:16:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:16:20.026189 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab9ac-c760-4024-9280-7fc50c10cf81 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:20.026727 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab9ac-c760-4024-9280-7fc50c10cf81 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:20.026727 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab9ac-c760-4024-9280-7fc50c10cf81 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:20.028011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 543/1093] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:16:20.034717 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e6bc-c1f3-4d9b-b237-d14bc090c8ae None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:20.035231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e6bc-c1f3-4d9b-b237-d14bc090c8ae None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:20.035336 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e6bc-c1f3-4d9b-b237-d14bc090c8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:20.056434 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-2c15e6bc-c1f3-4d9b-b237-d14bc090c8ae None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:20.057660 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-2c15e6bc-c1f3-4d9b-b237-d14bc090c8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:20.066049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 551/1094] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:16:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:16:20.090682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab9ac-c760-4024-9280-7fc50c10cf81 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:20.104522 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab9ac-c760-4024-9280-7fc50c10cf81 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:20.110300 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c203b-2369-44a6-b8c5-71eaf9734a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:20.110931 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c203b-2369-44a6-b8c5-71eaf9734a64 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:20.111210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c203b-2369-44a6-b8c5-71eaf9734a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:20.111485 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c203b-2369-44a6-b8c5-71eaf9734a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:20.112181 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c203b-2369-44a6-b8c5-71eaf9734a64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:20.114008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-d49c203b-2369-44a6-b8c5-71eaf9734a64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:16:20.114008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:16:20.114008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:16:20.115162 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c203b-2369-44a6-b8c5-71eaf9734a64 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:20.134643 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 544/1095] 10.222.0.71 () {56 vars in 1108 bytes} [Wed Jul 27 19:16:20 2022] GET /identity/v3/projects => generated 1606 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:16:22.494601 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c050-3ddd-4a12-84a9-e7bb73981c0e None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:22.495146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c050-3ddd-4a12-84a9-e7bb73981c0e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:22.495146 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c050-3ddd-4a12-84a9-e7bb73981c0e None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:22.496436 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 552/1096] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:16:22.502461 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4f0f0-ec54-4103-8fd5-6376a554a114 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:22.502947 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4f0f0-ec54-4103-8fd5-6376a554a114 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:22.503140 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4f0f0-ec54-4103-8fd5-6376a554a114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:22.522820 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-abf4f0f0-ec54-4103-8fd5-6376a554a114 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:22.524043 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-abf4f0f0-ec54-4103-8fd5-6376a554a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:22.532849 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 545/1097] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:16:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:16:22.579313 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1c050-3ddd-4a12-84a9-e7bb73981c0e None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:22.594807 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1c050-3ddd-4a12-84a9-e7bb73981c0e None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:22.599836 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c8906-eef6-4e40-804c-1df6488baf7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:22.600459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c8906-eef6-4e40-804c-1df6488baf7b service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:22.600744 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c8906-eef6-4e40-804c-1df6488baf7b service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:22.601024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c8906-eef6-4e40-804c-1df6488baf7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:22.612082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c8906-eef6-4e40-804c-1df6488baf7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:22.615167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c8906-eef6-4e40-804c-1df6488baf7b service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:22.626303 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 553/1098] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:16:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:16:25.087516 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d3ee2-a047-41c4-ac18-08b0c025d601 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:25.088072 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d3ee2-a047-41c4-ac18-08b0c025d601 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:25.088072 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d3ee2-a047-41c4-ac18-08b0c025d601 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:25.089410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 546/1099] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:16:25.095527 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8b5e-a2a8-43bd-8fb3-09d43534aa82 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:25.095976 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8b5e-a2a8-43bd-8fb3-09d43534aa82 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:25.096086 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8b5e-a2a8-43bd-8fb3-09d43534aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:25.115433 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-23ec8b5e-a2a8-43bd-8fb3-09d43534aa82 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:25.116646 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-23ec8b5e-a2a8-43bd-8fb3-09d43534aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:25.125722 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 554/1100] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:16:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:16:25.164153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d3ee2-a047-41c4-ac18-08b0c025d601 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:25.175572 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d3ee2-a047-41c4-ac18-08b0c025d601 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:25.179338 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c586bc1-5d98-41f1-96d6-45053cba8d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:25.179965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c586bc1-5d98-41f1-96d6-45053cba8d87 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:25.180246 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c586bc1-5d98-41f1-96d6-45053cba8d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:25.180523 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c586bc1-5d98-41f1-96d6-45053cba8d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:25.192590 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c586bc1-5d98-41f1-96d6-45053cba8d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:25.194107 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c586bc1-5d98-41f1-96d6-45053cba8d87 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:25.204337 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 547/1101] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:16:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:16:27.555375 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1fd77-02cf-40fc-841f-934e4cf4fbab None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:27.555941 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1fd77-02cf-40fc-841f-934e4cf4fbab None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:27.555941 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1fd77-02cf-40fc-841f-934e4cf4fbab None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:27.557259 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 555/1102] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:16:27.562996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a99601-be03-45f5-9cf0-9a62d9e6b09d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:27.563498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a99601-be03-45f5-9cf0-9a62d9e6b09d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:27.563603 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a99601-be03-45f5-9cf0-9a62d9e6b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:27.583002 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-a9a99601-be03-45f5-9cf0-9a62d9e6b09d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:27.584226 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a9a99601-be03-45f5-9cf0-9a62d9e6b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:27.592111 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 548/1103] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:16:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:16:27.631750 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1fd77-02cf-40fc-841f-934e4cf4fbab None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:27.642453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1fd77-02cf-40fc-841f-934e4cf4fbab None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:27.646038 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f92c8-eb1b-4e4f-b906-643abf9e55cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:27.646682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f92c8-eb1b-4e4f-b906-643abf9e55cd service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:27.646965 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f92c8-eb1b-4e4f-b906-643abf9e55cd service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:27.647236 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f92c8-eb1b-4e4f-b906-643abf9e55cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:27.657028 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f92c8-eb1b-4e4f-b906-643abf9e55cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:27.658507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f92c8-eb1b-4e4f-b906-643abf9e55cd service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:27.669478 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 556/1104] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:16:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:16:30.068459 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0555-5a6d-4142-a26a-c1f8165574e9 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:30.068970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0555-5a6d-4142-a26a-c1f8165574e9 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:30.068970 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0555-5a6d-4142-a26a-c1f8165574e9 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:30.070288 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 549/1105] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:16:30.075371 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba06ed-3934-49a5-81c2-5cfd19fb53bf None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:30.075768 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba06ed-3934-49a5-81c2-5cfd19fb53bf None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:30.075916 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba06ed-3934-49a5-81c2-5cfd19fb53bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:30.095196 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-dfba06ed-3934-49a5-81c2-5cfd19fb53bf None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:30.096389 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-dfba06ed-3934-49a5-81c2-5cfd19fb53bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:30.104055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 557/1106] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:16:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:16:30.146309 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db0555-5a6d-4142-a26a-c1f8165574e9 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:30.157228 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db0555-5a6d-4142-a26a-c1f8165574e9 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:30.160768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed58b8-72ba-457f-82c1-b37975f2cade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:30.161385 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed58b8-72ba-457f-82c1-b37975f2cade service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:30.161694 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed58b8-72ba-457f-82c1-b37975f2cade service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:30.161978 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed58b8-72ba-457f-82c1-b37975f2cade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:30.172287 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed58b8-72ba-457f-82c1-b37975f2cade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:30.173769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed58b8-72ba-457f-82c1-b37975f2cade service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:30.183599 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 550/1107] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:16:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:16:32.695586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294126c-0855-4f43-ad88-aa041f20159d None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:32.696166 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294126c-0855-4f43-ad88-aa041f20159d None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:32.696166 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294126c-0855-4f43-ad88-aa041f20159d None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:32.697455 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 558/1108] 10.222.0.71 () {54 vars in 926 bytes} [Wed Jul 27 19:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:16:32.703222 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad891c3-bdba-473a-8682-b1068f8cebef None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:32.703725 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad891c3-bdba-473a-8682-b1068f8cebef None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:32.703804 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad891c3-bdba-473a-8682-b1068f8cebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:32.724012 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-8ad891c3-bdba-473a-8682-b1068f8cebef None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:32.725245 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-8ad891c3-bdba-473a-8682-b1068f8cebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:32.734370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 551/1109] 10.222.0.71 () {58 vars in 1023 bytes} [Wed Jul 27 19:16:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:16:32.774029 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294126c-0855-4f43-ad88-aa041f20159d None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:32.785484 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294126c-0855-4f43-ad88-aa041f20159d None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:32.789059 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b87c6-99d6-4f23-bb87-11b74b714337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:32.789695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b87c6-99d6-4f23-bb87-11b74b714337 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:32.789978 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b87c6-99d6-4f23-bb87-11b74b714337 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:32.790817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b87c6-99d6-4f23-bb87-11b74b714337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:32.803061 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b87c6-99d6-4f23-bb87-11b74b714337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:32.804575 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b87c6-99d6-4f23-bb87-11b74b714337 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:32.815640 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 559/1110] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:16:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:16:42.718756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=33 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:16:42.810377 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=33 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:18:05.163673 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc2287-9d2d-42f7-8731-4dba45ef8d34 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.164283 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc2287-9d2d-42f7-8731-4dba45ef8d34 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.164283 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc2287-9d2d-42f7-8731-4dba45ef8d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.185659 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-8ebc2287-9d2d-42f7-8731-4dba45ef8d34 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:18:05.186927 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-8ebc2287-9d2d-42f7-8731-4dba45ef8d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:18:05.195200 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 552/1111] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:18:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:18:05.204596 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a86786-739b-422c-8c65-7f56d6773ab6 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.205186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a86786-739b-422c-8c65-7f56d6773ab6 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.205186 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a86786-739b-422c-8c65-7f56d6773ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.224449 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-c0a86786-739b-422c-8c65-7f56d6773ab6 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:18:05.225718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-c0a86786-739b-422c-8c65-7f56d6773ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:18:05.233854 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 560/1112] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:18:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:18:05.238608 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc2287-9d2d-42f7-8731-4dba45ef8d34 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.249710 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc2287-9d2d-42f7-8731-4dba45ef8d34 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.254605 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.255229 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.255525 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.255800 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] PATH_INFO: `/v3/domains` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.256488 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:18:05.256788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.258404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:05.258404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:18:05.258404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:18:05.258734 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:05.271467 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 553/1113] 10.222.0.71 () {58 vars in 1153 bytes} [Wed Jul 27 19:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:18:05.280157 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a86786-739b-422c-8c65-7f56d6773ab6 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.289556 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a86786-739b-422c-8c65-7f56d6773ab6 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.294475 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.295116 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.295399 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.295674 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.296355 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.298185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING py.warnings [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:05.298185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: warnings.warn(msg) Jul 27 19:18:05.298185 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: Jul 27 19:18:05.299386 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:05.329989 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 561/1114] 10.222.0.71 () {60 vars in 1153 bytes} [Wed Jul 27 19:18:05 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:18:05.334341 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.345094 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c929e3-e24e-40ad-9ebc-60158bfbac53 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.408055 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.408690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.408973 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.409249 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.409973 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.410988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:05.410988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:18:05.410988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:18:05.412204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:05.434682 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 554/1115] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:18:05 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:18:05.438991 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.450535 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2f5a-1a5a-4bb0-974e-1d3ccf9c902f admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.455305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.456032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.456344 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.456639 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.457347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.458407 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING py.warnings [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:05.458407 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: warnings.warn(msg) Jul 27 19:18:05.458407 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: Jul 27 19:18:05.459305 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:05.474217 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 562/1116] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:18:05.478431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.493128 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dfa3f-9588-4032-a2a5-6e0ac8613562 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.498870 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbfcfd-2f14-4022-99f5-16fa215d1053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.499486 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfcfd-2f14-4022-99f5-16fa215d1053 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.499763 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfcfd-2f14-4022-99f5-16fa215d1053 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.500035 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfcfd-2f14-4022-99f5-16fa215d1053 admin admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.500724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbfcfd-2f14-4022-99f5-16fa215d1053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.501753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-bcdbfcfd-2f14-4022-99f5-16fa215d1053 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:05.501753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:18:05.501753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:18:05.502659 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbfcfd-2f14-4022-99f5-16fa215d1053 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:05.517898 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 555/1117] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:18:05.523347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.534469 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777f6db-85df-4099-81e4-5d0a6079fbe3 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.539329 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def7a2-eea3-45df-95a8-8902239abf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.540008 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def7a2-eea3-45df-95a8-8902239abf98 admin admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.540287 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def7a2-eea3-45df-95a8-8902239abf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.540562 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def7a2-eea3-45df-95a8-8902239abf98 admin admin] PATH_INFO: `/v3/projects/6076a77f415b43c1a442eeddde9f7f9a/users/9998791c35c94cc690418ab89fdd561c/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.557738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def7a2-eea3-45df-95a8-8902239abf98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6076a77f415b43c1a442eeddde9f7f9a, user_id=9998791c35c94cc690418ab89fdd561c, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.558971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING py.warnings [None req-34def7a2-eea3-45df-95a8-8902239abf98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:05.558971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: warnings.warn(msg) Jul 27 19:18:05.558971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: Jul 27 19:18:05.560910 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def7a2-eea3-45df-95a8-8902239abf98 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:05.575763 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 563/1118] 10.222.0.71 () {60 vars in 1483 bytes} [Wed Jul 27 19:18:05 2022] PUT /identity/v3/projects/6076a77f415b43c1a442eeddde9f7f9a/users/9998791c35c94cc690418ab89fdd561c/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:18:05.589553 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177496a-95e1-4844-a86a-3bbcaa109979 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.589995 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177496a-95e1-4844-a86a-3bbcaa109979 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.590406 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177496a-95e1-4844-a86a-3bbcaa109979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.625552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-7177496a-95e1-4844-a86a-3bbcaa109979 None None] MFA Rules not processed for user `9998791c35c94cc690418ab89fdd561c`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:18:05.626823 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-7177496a-95e1-4844-a86a-3bbcaa109979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:18:05.708677 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 556/1119] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:18:05 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:18:05.723840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20743f-f1f2-4268-9d50-7b6ae128b784 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.724134 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20743f-f1f2-4268-9d50-7b6ae128b784 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.724416 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20743f-f1f2-4268-9d50-7b6ae128b784 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.725860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 564/1120] 10.222.0.71 () {54 vars in 964 bytes} [Wed Jul 27 19:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:18:05.731468 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4898b6-2042-462e-877f-5b9a7da2315f None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.731800 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4898b6-2042-462e-877f-5b9a7da2315f None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.732082 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4898b6-2042-462e-877f-5b9a7da2315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.753839 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-4e4898b6-2042-462e-877f-5b9a7da2315f None None] MFA Rules not processed for user `7605bd73b8204acba28a144a64d5eee7`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:18:05.755124 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-4e4898b6-2042-462e-877f-5b9a7da2315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:18:05.811563 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:18:05.821429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 557/1121] 10.222.0.71 () {58 vars in 1061 bytes} [Wed Jul 27 19:18:05 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:18:05.829517 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20743f-f1f2-4268-9d50-7b6ae128b784 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.840860 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20743f-f1f2-4268-9d50-7b6ae128b784 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.844870 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7605bd73b8204acba28a144a64d5eee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.845617 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.845938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.846209 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.857215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.859007 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:05.870193 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 565/1122] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:18:05 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:18:05.912072 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c468002-9a0e-4251-bd9a-5d6a3bb1e453 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.912361 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c468002-9a0e-4251-bd9a-5d6a3bb1e453 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.912637 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c468002-9a0e-4251-bd9a-5d6a3bb1e453 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.915177 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 558/1123] 10.222.0.71 () {52 vars in 830 bytes} [Wed Jul 27 19:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:18:05.919958 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:05.986191 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063106-925a-4b93-8cb4-edfd545aba92 service cinder] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:05.990560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:05.991214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:05.991493 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:05.991765 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] PATH_INFO: `/v3/users/9998791c35c94cc690418ab89fdd561c` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:05.992962 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9998791c35c94cc690418ab89fdd561c)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:05.994019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING py.warnings [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:05.994019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: warnings.warn(msg) Jul 27 19:18:05.994019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: Jul 27 19:18:05.995216 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:06.063656 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9998791c35c94cc690418ab89fdd561c'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.075534 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9998791c35c94cc690418ab89fdd561c'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.095161 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9998791c35c94cc690418ab89fdd561c'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.108406 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9998791c35c94cc690418ab89fdd561c'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.109262 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9998791c35c94cc690418ab89fdd561c'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.115324 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 566/1124] 10.222.0.71 () {58 vars in 1224 bytes} [Wed Jul 27 19:18:05 2022] DELETE /identity/v3/users/9998791c35c94cc690418ab89fdd561c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:18:06.119788 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:06.120070 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:06.120435 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:06.139427 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:18:06.140852 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:18:06.210921 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 559/1125] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:18:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:18:06.223016 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:06.224646 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:18:06.231055 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:18:06.298595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869f99-a9d8-45d9-8618-9ffd99e39aed admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:06.302153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03fe97-fabd-455c-8c7b-197b2dfa6b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:06.302782 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fe97-fabd-455c-8c7b-197b2dfa6b5d service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:06.303060 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fe97-fabd-455c-8c7b-197b2dfa6b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:06.303328 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fe97-fabd-455c-8c7b-197b2dfa6b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:06.313568 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03fe97-fabd-455c-8c7b-197b2dfa6b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:06.315036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03fe97-fabd-455c-8c7b-197b2dfa6b5d service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:06.326575 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 567/1126] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:18:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:18:06.716967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:18:06.718475 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:18:06.741851 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dac462-863b-4a94-a0f6-b63b589c8680 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:18:06.747204 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:18:06.747882 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:18:06.748156 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:18:06.748429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] PATH_INFO: `/v3/projects/6076a77f415b43c1a442eeddde9f7f9a` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:18:06.749640 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6076a77f415b43c1a442eeddde9f7f9a)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:18:06.750993 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:18:06.750993 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:18:06.750993 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:18:06.752355 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:18:06.815341 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6076a77f415b43c1a442eeddde9f7f9a', 'request_id': 'req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.821397 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6076a77f415b43c1a442eeddde9f7f9a', 'request_id': 'req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.835988 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6076a77f415b43c1a442eeddde9f7f9a', 'request_id': 'req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.851576 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] The token cache is being invalidate because project 6076a77f415b43c1a442eeddde9f7f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:18:06.851869 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.852487 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-dfd94867-5429-4f28-aa01-fc2e4ee42fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:18:06.854179 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 560/1127] 10.222.0.71 () {58 vars in 1233 bytes} [Wed Jul 27 19:18:06 2022] DELETE /identity/v3/projects/6076a77f415b43c1a442eeddde9f7f9a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:18:16.320851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=25 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:18:16.848399 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:19:30.317934 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fe95-632d-46cc-90a8-da47b3abab30 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:30.318759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fe95-632d-46cc-90a8-da47b3abab30 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:30.318759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fe95-632d-46cc-90a8-da47b3abab30 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:30.319899 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 568/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:19:30.325208 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3265f9-f136-4d93-8695-32220d027e3c None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:30.325837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3265f9-f136-4d93-8695-32220d027e3c None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:30.325837 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3265f9-f136-4d93-8695-32220d027e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:30.411331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-fc3265f9-f136-4d93-8695-32220d027e3c None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:30.412709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-fc3265f9-f136-4d93-8695-32220d027e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:30.515741 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 561/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:19:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:30.678330 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fe95-632d-46cc-90a8-da47b3abab30 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:30.680105 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9030fe95-632d-46cc-90a8-da47b3abab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:30.770925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fe95-632d-46cc-90a8-da47b3abab30 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:30.776174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62072a55-9586-4ad7-8dea-d575c82e8c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:30.776800 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072a55-9586-4ad7-8dea-d575c82e8c1d service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:30.777089 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072a55-9586-4ad7-8dea-d575c82e8c1d service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:30.777368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072a55-9586-4ad7-8dea-d575c82e8c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:30.786333 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62072a55-9586-4ad7-8dea-d575c82e8c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:30.788045 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62072a55-9586-4ad7-8dea-d575c82e8c1d service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:30.799479 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 569/1130] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:31.662845 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a721-f229-4ae8-a938-64ad3aa21812 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:31.663464 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a721-f229-4ae8-a938-64ad3aa21812 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:31.663464 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a721-f229-4ae8-a938-64ad3aa21812 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:31.664823 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 562/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:19:31.670384 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3f75-075b-4bb5-92cc-2e18e88b8946 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:31.670879 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3f75-075b-4bb5-92cc-2e18e88b8946 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:31.671009 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3f75-075b-4bb5-92cc-2e18e88b8946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:31.691663 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-854c3f75-075b-4bb5-92cc-2e18e88b8946 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:31.692859 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-854c3f75-075b-4bb5-92cc-2e18e88b8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:31.700714 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 570/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:19:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:31.860647 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a721-f229-4ae8-a938-64ad3aa21812 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:31.874935 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a721-f229-4ae8-a938-64ad3aa21812 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:31.879836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bc0aa-6d18-4948-91dc-2295cb1834ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:31.880446 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc0aa-6d18-4948-91dc-2295cb1834ae service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:31.880724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc0aa-6d18-4948-91dc-2295cb1834ae service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:31.880996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc0aa-6d18-4948-91dc-2295cb1834ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:31.889137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bc0aa-6d18-4948-91dc-2295cb1834ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:31.890961 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bc0aa-6d18-4948-91dc-2295cb1834ae service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:31.900326 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 563/1133] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:36.241863 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae302a-eeb2-4d8f-8aa4-5e793bb1fccb None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:36.242396 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae302a-eeb2-4d8f-8aa4-5e793bb1fccb None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:36.242396 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae302a-eeb2-4d8f-8aa4-5e793bb1fccb None None] PATH_INFO: `/v3` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:36.243617 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 571/1134] 10.222.0.27 () {54 vars in 925 bytes} [Wed Jul 27 19:19:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:19:36.251149 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb915f69-c340-422d-871a-620c506876c0 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:36.251549 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb915f69-c340-422d-871a-620c506876c0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:36.251706 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb915f69-c340-422d-871a-620c506876c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:36.280643 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-fb915f69-c340-422d-871a-620c506876c0 None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:36.281869 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-fb915f69-c340-422d-871a-620c506876c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:36.335277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:19:36.345349 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 564/1135] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jul 27 19:19:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:40.380558 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51da8-349a-45ef-9339-5da0f740164f None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:40.381070 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51da8-349a-45ef-9339-5da0f740164f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:40.381070 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51da8-349a-45ef-9339-5da0f740164f None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:40.382406 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 572/1136] 10.222.0.71 () {54 vars in 961 bytes} [Wed Jul 27 19:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:19:40.387589 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c078d4-7250-4183-9cd7-ec92deb6a30a None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:40.387998 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c078d4-7250-4183-9cd7-ec92deb6a30a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:40.388159 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c078d4-7250-4183-9cd7-ec92deb6a30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:40.408820 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-41c078d4-7250-4183-9cd7-ec92deb6a30a None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:40.410040 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-41c078d4-7250-4183-9cd7-ec92deb6a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:40.418493 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 565/1137] 10.222.0.71 () {58 vars in 1058 bytes} [Wed Jul 27 19:19:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:40.426570 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a51da8-349a-45ef-9339-5da0f740164f None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:40.447321 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a51da8-349a-45ef-9339-5da0f740164f None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:40.452477 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e137b4d-a107-4ba5-8353-f3992cf6857f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:40.453088 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137b4d-a107-4ba5-8353-f3992cf6857f service placement] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:40.453367 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137b4d-a107-4ba5-8353-f3992cf6857f service placement] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:40.453723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137b4d-a107-4ba5-8353-f3992cf6857f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:40.462167 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e137b4d-a107-4ba5-8353-f3992cf6857f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:40.463771 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e137b4d-a107-4ba5-8353-f3992cf6857f service placement] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:40.474754 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 573/1138] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:40 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:43.147123 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59111b6b-1b28-4293-9f03-44419fa8d065 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:43.147817 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59111b6b-1b28-4293-9f03-44419fa8d065 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:43.147817 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59111b6b-1b28-4293-9f03-44419fa8d065 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:43.148996 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:19:43.153984 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425817-b380-45a6-93c3-c67090c5dd8e None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:43.154418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425817-b380-45a6-93c3-c67090c5dd8e None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:43.155297 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425817-b380-45a6-93c3-c67090c5dd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:43.174499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-54425817-b380-45a6-93c3-c67090c5dd8e None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:43.175695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-54425817-b380-45a6-93c3-c67090c5dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:43.184202 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:19:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:43.342558 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59111b6b-1b28-4293-9f03-44419fa8d065 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:43.356253 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59111b6b-1b28-4293-9f03-44419fa8d065 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:43.361858 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52706e32-5d27-4eab-bdc4-05cc68a370be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:43.362469 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706e32-5d27-4eab-bdc4-05cc68a370be service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:43.362753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706e32-5d27-4eab-bdc4-05cc68a370be service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:43.363032 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706e32-5d27-4eab-bdc4-05cc68a370be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:43.371210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52706e32-5d27-4eab-bdc4-05cc68a370be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:43.373082 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52706e32-5d27-4eab-bdc4-05cc68a370be service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:43.382789 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 567/1141] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:19:44.271873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec98-8b1e-4bed-acc8-bcbc4f0cc114 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:44.272640 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec98-8b1e-4bed-acc8-bcbc4f0cc114 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:44.272640 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec98-8b1e-4bed-acc8-bcbc4f0cc114 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:44.273792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:19:44.278823 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66459d4-235e-4c0c-acca-f64d60313ffe None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:44.279274 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66459d4-235e-4c0c-acca-f64d60313ffe None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:44.279366 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66459d4-235e-4c0c-acca-f64d60313ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:44.300785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-d66459d4-235e-4c0c-acca-f64d60313ffe None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:44.302062 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-d66459d4-235e-4c0c-acca-f64d60313ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:44.311033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:19:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:44.519151 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ec98-8b1e-4bed-acc8-bcbc4f0cc114 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:44.534600 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ec98-8b1e-4bed-acc8-bcbc4f0cc114 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:44.539553 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab8362-eb5b-4cb6-8b03-230065cd4387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:44.540170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8362-eb5b-4cb6-8b03-230065cd4387 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:44.540531 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8362-eb5b-4cb6-8b03-230065cd4387 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:44.540793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8362-eb5b-4cb6-8b03-230065cd4387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:44.549999 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab8362-eb5b-4cb6-8b03-230065cd4387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:44.551606 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab8362-eb5b-4cb6-8b03-230065cd4387 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:44.562839 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 576/1144] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:49.062350 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ab07-39e3-4c3e-886b-d0b2092a5c8c None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:49.063001 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ab07-39e3-4c3e-886b-d0b2092a5c8c None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:49.063001 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ab07-39e3-4c3e-886b-d0b2092a5c8c None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:49.064209 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:19:49.069806 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aab98-16a5-493d-8d7f-72722fdc5045 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:49.070232 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aab98-16a5-493d-8d7f-72722fdc5045 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:49.070364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aab98-16a5-493d-8d7f-72722fdc5045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:49.090398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-cf6aab98-16a5-493d-8d7f-72722fdc5045 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:49.091602 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-cf6aab98-16a5-493d-8d7f-72722fdc5045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:49.100788 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:19:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:49.140011 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875ab07-39e3-4c3e-886b-d0b2092a5c8c None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:49.141780 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-4875ab07-39e3-4c3e-886b-d0b2092a5c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:49.199182 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875ab07-39e3-4c3e-886b-d0b2092a5c8c None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:49.203784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a88837-70f1-4ade-922e-87e3af25fe80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:49.204408 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a88837-70f1-4ade-922e-87e3af25fe80 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:49.204694 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a88837-70f1-4ade-922e-87e3af25fe80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:49.204972 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a88837-70f1-4ade-922e-87e3af25fe80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:49.213938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a88837-70f1-4ade-922e-87e3af25fe80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:49.215373 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a88837-70f1-4ade-922e-87e3af25fe80 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:49.225806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 570/1147] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:51.448411 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0227-888c-42b7-9e86-6de2ddb8c194 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:51.448938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0227-888c-42b7-9e86-6de2ddb8c194 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:51.448938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0227-888c-42b7-9e86-6de2ddb8c194 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:51.450397 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 578/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:19:51.456235 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6205-d2d0-4b3b-953c-80897703a85d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:51.456676 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6205-d2d0-4b3b-953c-80897703a85d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:51.456784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6205-d2d0-4b3b-953c-80897703a85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:51.476735 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-df0e6205-d2d0-4b3b-953c-80897703a85d None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:51.478013 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-df0e6205-d2d0-4b3b-953c-80897703a85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:51.486915 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 571/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:19:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:19:51.525342 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0227-888c-42b7-9e86-6de2ddb8c194 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:51.536822 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0227-888c-42b7-9e86-6de2ddb8c194 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:51.541032 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb0e29-712b-436a-bcca-92ca8f8a4d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:51.541856 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb0e29-712b-436a-bcca-92ca8f8a4d46 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:51.542144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb0e29-712b-436a-bcca-92ca8f8a4d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:51.542421 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb0e29-712b-436a-bcca-92ca8f8a4d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:51.552581 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb0e29-712b-436a-bcca-92ca8f8a4d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:51.554030 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb0e29-712b-436a-bcca-92ca8f8a4d46 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:51.564019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 579/1150] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:55.762284 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e656af-fcbd-47ae-b2ef-fde1434e1cb4 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:55.763024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e656af-fcbd-47ae-b2ef-fde1434e1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:55.763024 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e656af-fcbd-47ae-b2ef-fde1434e1cb4 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:55.764940 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 572/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:19:55.771215 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce3af-b368-4627-a327-a0e769603a29 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:55.771803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce3af-b368-4627-a327-a0e769603a29 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:55.771803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce3af-b368-4627-a327-a0e769603a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:55.798666 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-169ce3af-b368-4627-a327-a0e769603a29 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:55.800736 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-169ce3af-b368-4627-a327-a0e769603a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:55.812729 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 580/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:19:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:19:56.109148 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e656af-fcbd-47ae-b2ef-fde1434e1cb4 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:56.111067 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-35e656af-fcbd-47ae-b2ef-fde1434e1cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:56.176999 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e656af-fcbd-47ae-b2ef-fde1434e1cb4 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:56.180565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4e39d-5a89-4bfe-a70d-cd0360eefb4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7605bd73b8204acba28a144a64d5eee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:56.181189 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e39d-5a89-4bfe-a70d-cd0360eefb4a service cinder] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:56.181476 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e39d-5a89-4bfe-a70d-cd0360eefb4a service cinder] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:56.181785 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e39d-5a89-4bfe-a70d-cd0360eefb4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:56.192756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4e39d-5a89-4bfe-a70d-cd0360eefb4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:56.194243 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4e39d-5a89-4bfe-a70d-cd0360eefb4a service cinder] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:56.204466 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 573/1153] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:58.689082 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e264-b60d-40e1-a5d9-86f170a249e6 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:58.689760 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e264-b60d-40e1-a5d9-86f170a249e6 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:58.689760 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e264-b60d-40e1-a5d9-86f170a249e6 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:58.691097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 581/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:19:58.696688 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b80f-97c1-4233-a631-e2c4d382fce0 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:58.697244 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b80f-97c1-4233-a631-e2c4d382fce0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:58.697354 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b80f-97c1-4233-a631-e2c4d382fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:58.721423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-db78b80f-97c1-4233-a631-e2c4d382fce0 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:19:58.722686 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-db78b80f-97c1-4233-a631-e2c4d382fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:58.731576 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 574/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:19:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:19:59.027202 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5e264-b60d-40e1-a5d9-86f170a249e6 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:59.030120 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-39a5e264-b60d-40e1-a5d9-86f170a249e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:59.038766 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=70 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:19:59.046374 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5e264-b60d-40e1-a5d9-86f170a249e6 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:59.050126 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4be24f-7dac-4911-89ce-0d1160d311ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7605bd73b8204acba28a144a64d5eee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:59.050741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be24f-7dac-4911-89ce-0d1160d311ee service cinder] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:59.051023 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be24f-7dac-4911-89ce-0d1160d311ee service cinder] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:59.051328 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be24f-7dac-4911-89ce-0d1160d311ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:59.061103 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4be24f-7dac-4911-89ce-0d1160d311ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:59.062564 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4be24f-7dac-4911-89ce-0d1160d311ee service cinder] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:59.072750 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 582/1156] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:20:08.712560 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=70 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:20:09.068113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=5 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:20.197176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c940ea2-cd8f-42de-b457-73a9d98e5111 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.198026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c940ea2-cd8f-42de-b457-73a9d98e5111 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.198026 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c940ea2-cd8f-42de-b457-73a9d98e5111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.278718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3539-af54-4bd7-8866-05e4a0a24c29 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.279368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3539-af54-4bd7-8866-05e4a0a24c29 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.279368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3539-af54-4bd7-8866-05e4a0a24c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.302635 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-dd0b3539-af54-4bd7-8866-05e4a0a24c29 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:20.304439 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-dd0b3539-af54-4bd7-8866-05e4a0a24c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:20.314715 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 583/1157] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:20.324804 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4bd7d-684a-41a3-80e8-6b4f72c789fc None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.325143 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4bd7d-684a-41a3-80e8-6b4f72c789fc None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.325419 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4bd7d-684a-41a3-80e8-6b4f72c789fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.350467 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-3c940ea2-cd8f-42de-b457-73a9d98e5111 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:20.350747 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-45a4bd7d-684a-41a3-80e8-6b4f72c789fc None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:20.351688 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-3c940ea2-cd8f-42de-b457-73a9d98e5111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:20.351807 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-45a4bd7d-684a-41a3-80e8-6b4f72c789fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:20.360024 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 584/1158] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:21:20.360779 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 575/1159] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:20.364991 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4bd7d-684a-41a3-80e8-6b4f72c789fc None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.370495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aea1d-a037-42ea-b9a1-98a3db9836f8 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.370767 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aea1d-a037-42ea-b9a1-98a3db9836f8 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.371301 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aea1d-a037-42ea-b9a1-98a3db9836f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.375423 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4bd7d-684a-41a3-80e8-6b4f72c789fc None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.381840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.383797 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.384101 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.384394 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.385179 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:21:20.385560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.386664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING py.warnings [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:21:20.386664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: warnings.warn(msg) Jul 27 19:21:20.386664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: Jul 27 19:21:20.387698 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.395358 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-058aea1d-a037-42ea-b9a1-98a3db9836f8 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:20.396145 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-058aea1d-a037-42ea-b9a1-98a3db9836f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:20.403452 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 585/1160] 10.222.0.71 () {58 vars in 1153 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:21:20.404423 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 576/1161] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:21:20.409988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.413196 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aea1d-a037-42ea-b9a1-98a3db9836f8 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.422628 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829935-a7ed-4439-be85-92b1ce1774a9 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.424703 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aea1d-a037-42ea-b9a1-98a3db9836f8 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.428834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.429463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.429777 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.430060 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] PATH_INFO: `/v3/domains` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.430754 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:21:20.431058 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.432681 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.432908 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.433618 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.433983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.434585 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.436037 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.437057 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:21:20.437057 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:21:20.437057 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:21:20.438596 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.448078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 586/1162] 10.222.0.71 () {58 vars in 1153 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:21:20.458069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.471834 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a5d5-24c7-4815-80a3-4680dc0a8845 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.479978 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.481246 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.481548 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.481985 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.482699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.484988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.491704 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 577/1163] 10.222.0.71 () {60 vars in 1153 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:21:20.495751 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.524294 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 587/1164] 10.222.0.71 () {60 vars in 1153 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:21:20.525315 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.567452 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfac62-5ffe-43b9-a3b5-f6962fb18fa9 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.600410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7a99f-9975-4400-abf9-bc03d3eeae0b admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.606307 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.606933 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.607248 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.607565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.608272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.609507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING py.warnings [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:21:20.609507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: warnings.warn(msg) Jul 27 19:21:20.609507 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: Jul 27 19:21:20.611711 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.626724 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.627546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.627840 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.628271 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.629014 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.631762 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.638865 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 588/1165] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:21:20.646074 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.655571 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 578/1166] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:21:20.659561 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c391e-3361-46ea-a901-33a99cafc71f admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.660494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.664892 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.665523 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.665841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.666117 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.666984 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.668492 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.671827 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939d63-7242-4e1c-9698-7544f80f3e02 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.678480 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.679021 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.679298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.679568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.680258 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.681905 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.682019 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 589/1167] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:21:20.686457 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.696381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 579/1168] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:21:20.697688 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f231da-505b-4064-a75a-bfeca6f5cb6e admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.700748 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.703012 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.703594 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.705040 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.705369 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.706100 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.707695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.714126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a276394-4ec9-42b9-86bf-40f8c1f7eb03 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.718966 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 590/1169] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:21:20.720321 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.721126 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.721410 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.721708 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.722408 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.724107 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.724257 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.736967 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 580/1170] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:21:20.739637 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c9e23-3c0f-474d-87ef-dcb8b23c0272 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.741068 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.746665 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8a1e3-e23a-4bb9-b14a-f0b97ff9cd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.747454 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8a1e3-e23a-4bb9-b14a-f0b97ff9cd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.748001 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8a1e3-e23a-4bb9-b14a-f0b97ff9cd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.748180 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8a1e3-e23a-4bb9-b14a-f0b97ff9cd47 admin admin] PATH_INFO: `/v3/projects/5c5239d52719427089e8c8ac88b17384/users/f54bd75de20843fabd6b9f23b287529c/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.754740 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bedfae-1fe3-48fe-a479-50aba2bcc90c admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.761409 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8168a-f9bf-4998-a7c5-a1954d91b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.762470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8168a-f9bf-4998-a7c5-a1954d91b5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.762920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8168a-f9bf-4998-a7c5-a1954d91b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.763348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8168a-f9bf-4998-a7c5-a1954d91b5ba admin admin] PATH_INFO: `/v3/projects/c1cc865b98d64f6ca27cb77c69ee5877/users/51d6a93d6269486197b7178cf1dc03f1/roles/e01dafa93d884a19adb7866841e6ca91` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.766018 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8a1e3-e23a-4bb9-b14a-f0b97ff9cd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5239d52719427089e8c8ac88b17384, user_id=f54bd75de20843fabd6b9f23b287529c, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.769446 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8a1e3-e23a-4bb9-b14a-f0b97ff9cd47 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.782850 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8168a-f9bf-4998-a7c5-a1954d91b5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1cc865b98d64f6ca27cb77c69ee5877, user_id=51d6a93d6269486197b7178cf1dc03f1, role_id=e01dafa93d884a19adb7866841e6ca91)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.784153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-7ba8168a-f9bf-4998-a7c5-a1954d91b5ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:21:20.784153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:21:20.784153 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:21:20.786287 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 591/1171] 10.222.0.71 () {60 vars in 1483 bytes} [Wed Jul 27 19:21:20 2022] PUT /identity/v3/projects/5c5239d52719427089e8c8ac88b17384/users/f54bd75de20843fabd6b9f23b287529c/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:21:20.786567 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8168a-f9bf-4998-a7c5-a1954d91b5ba admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.792405 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020d217-77fc-4336-be55-5cc18cde753a None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.792732 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020d217-77fc-4336-be55-5cc18cde753a None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.793174 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020d217-77fc-4336-be55-5cc18cde753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.802919 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 581/1172] 10.222.0.71 () {60 vars in 1483 bytes} [Wed Jul 27 19:21:20 2022] PUT /identity/v3/projects/c1cc865b98d64f6ca27cb77c69ee5877/users/51d6a93d6269486197b7178cf1dc03f1/roles/e01dafa93d884a19adb7866841e6ca91 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:21:20.808108 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.808402 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.808697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.818400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-9020d217-77fc-4336-be55-5cc18cde753a None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:20.819642 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-9020d217-77fc-4336-be55-5cc18cde753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:20.822353 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:20.830136 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] MFA Rules not processed for user `9411e66c17864f3a88f0f7077545cca2`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:20.832167 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:20.866841 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:20.897911 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 592/1173] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:21:20.899805 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 582/1174] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:21:20.910177 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020d217-77fc-4336-be55-5cc18cde753a None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.911110 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:20.912600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:20.971699 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020d217-77fc-4336-be55-5cc18cde753a None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:20.975899 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb81c-8932-4cbd-a63b-5e11a54c58e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:20.976675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb81c-8932-4cbd-a63b-5e11a54c58e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:20.977022 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb81c-8932-4cbd-a63b-5e11a54c58e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:20.977214 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb81c-8932-4cbd-a63b-5e11a54c58e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:20.987682 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abb81c-8932-4cbd-a63b-5e11a54c58e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:20.989410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abb81c-8932-4cbd-a63b-5e11a54c58e9 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:20.996910 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223a23-09dd-4bfa-82d0-f5ba588685b6 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:21.000666 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:21.001983 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:21.002310 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:21.002574 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:21.004264 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 593/1175] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:21:21.013709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:21.015303 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:21.028348 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 583/1176] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:21:27.572704 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab76c-aeea-4fbc-92a0-4260bd4a263c None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:27.573683 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab76c-aeea-4fbc-92a0-4260bd4a263c None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:27.574141 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab76c-aeea-4fbc-92a0-4260bd4a263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:27.626894 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-f36ab76c-aeea-4fbc-92a0-4260bd4a263c None None] MFA Rules not processed for user `f54bd75de20843fabd6b9f23b287529c`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:27.628418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-f36ab76c-aeea-4fbc-92a0-4260bd4a263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:27.746229 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 594/1177] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:27 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:27.747151 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:27.758007 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a2ff3-fac1-4599-93c2-caab7d011b38 service neutron] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:27.762153 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83faf98-b085-443f-979a-9fdbc87e5350 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:27.762445 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83faf98-b085-443f-979a-9fdbc87e5350 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:27.762723 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83faf98-b085-443f-979a-9fdbc87e5350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:27.778278 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:27.778920 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:27.779201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:27.779476 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] PATH_INFO: `/v3/projects` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:27.780791 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:27.783324 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:27.834462 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-b83faf98-b085-443f-979a-9fdbc87e5350 None None] MFA Rules not processed for user `51d6a93d6269486197b7178cf1dc03f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:27.834917 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 584/1178] 10.222.0.71 () {60 vars in 1153 bytes} [Wed Jul 27 19:21:27 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:21:27.836657 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:27.837603 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-b83faf98-b085-443f-979a-9fdbc87e5350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:27.967362 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 595/1179] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:27 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:27.968759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83faf98-b085-443f-979a-9fdbc87e5350 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:27.976139 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134583e8-715d-4d4f-a1d7-8a07a6b0d0be admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:27.985835 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:27.987626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:27.987626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:27.987626 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:27.989712 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] PATH_INFO: `/v3/users` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:27.990461 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:27.992418 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:27.993609 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83faf98-b085-443f-979a-9fdbc87e5350 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.004696 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.005545 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.005960 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.006335 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.007915 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.010410 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.035233 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 585/1180] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:21:27 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:21:28.043154 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.064342 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dde36-1a74-4185-98f6-5d9d35f54c15 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.065829 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 596/1181] 10.222.0.71 () {60 vars in 1153 bytes} [Wed Jul 27 19:21:27 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:21:28.070046 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.072640 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:28.149470 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.150146 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.150425 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.150697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.151722 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.153610 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.164928 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765434-560a-42a1-bb10-24f651a912f6 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.169270 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 586/1182] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:21:28.170074 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.174201 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.174983 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.175378 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.175819 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] PATH_INFO: `/v3/users` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.176744 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.179090 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.181924 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea691b3-cbdd-4441-b65c-d2791db08dbc admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.186799 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.187624 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.187762 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.188622 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] PATH_INFO: `/v3/projects/4422c8c5086743df9f9a56ecc0be2539/users/d8d1c982df4641cb944a0f38185929e0/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.206195 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 597/1183] 10.222.0.71 () {60 vars in 1144 bytes} [Wed Jul 27 19:21:28 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:21:28.209189 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4422c8c5086743df9f9a56ecc0be2539, user_id=d8d1c982df4641cb944a0f38185929e0, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.210853 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.212005 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.223121 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caffac3-9cd6-4366-b521-42f607032468 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.228429 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 587/1184] 10.222.0.71 () {60 vars in 1483 bytes} [Wed Jul 27 19:21:28 2022] PUT /identity/v3/projects/4422c8c5086743df9f9a56ecc0be2539/users/d8d1c982df4641cb944a0f38185929e0/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:21:28.232335 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.292237 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.292872 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.293161 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.293443 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.294181 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.295974 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.307753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d54e37-d64b-40dd-8fba-ef403483c395 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.308463 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 598/1185] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:21:28.312233 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.315109 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.315822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.316173 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.316513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.317284 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.318975 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.325087 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e232-90be-4467-9acc-5931ef72dc03 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.331175 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 588/1186] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:21:28.334687 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.335275 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.335570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.335702 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.335823 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] PATH_INFO: `/v3/projects/1af09682be1f40aeb8049e0f9a8dc143/users/deecede409d74a98a99b195e7231d9ad/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.347445 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2650b-ebec-46e7-8214-7b9073277d55 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.352627 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.353437 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.353864 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.354242 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] PATH_INFO: `/v3/projects/4422c8c5086743df9f9a56ecc0be2539/users/d8d1c982df4641cb944a0f38185929e0/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.354368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af09682be1f40aeb8049e0f9a8dc143, user_id=deecede409d74a98a99b195e7231d9ad, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.356393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4422c8c5086743df9f9a56ecc0be2539, user_id=d8d1c982df4641cb944a0f38185929e0, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.357173 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.359381 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.374171 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 589/1187] 10.222.0.71 () {60 vars in 1483 bytes} [Wed Jul 27 19:21:28 2022] PUT /identity/v3/projects/4422c8c5086743df9f9a56ecc0be2539/users/d8d1c982df4641cb944a0f38185929e0/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:21:28.380033 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 599/1188] 10.222.0.71 () {60 vars in 1483 bytes} [Wed Jul 27 19:21:28 2022] PUT /identity/v3/projects/1af09682be1f40aeb8049e0f9a8dc143/users/deecede409d74a98a99b195e7231d9ad/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:21:28.383874 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.521534 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9118928-405c-4adb-8d13-60c5d347fc17 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.531357 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:28.603855 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0535c1c-4f46-439c-aafe-f134aa8cc8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.604681 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0535c1c-4f46-439c-aafe-f134aa8cc8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.605124 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0535c1c-4f46-439c-aafe-f134aa8cc8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.605587 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0535c1c-4f46-439c-aafe-f134aa8cc8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.606464 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0535c1c-4f46-439c-aafe-f134aa8cc8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.608904 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0535c1c-4f46-439c-aafe-f134aa8cc8e1 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.626965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 590/1189] 10.222.0.71 () {58 vars in 1122 bytes} [Wed Jul 27 19:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:21:28.628231 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:28.642925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9dc8-a78e-422f-9de4-049e99139046 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:28.649999 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2080f1-8e97-4d7f-9b59-38980f286b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:28.650977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2080f1-8e97-4d7f-9b59-38980f286b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:28.651235 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2080f1-8e97-4d7f-9b59-38980f286b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:28.651513 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2080f1-8e97-4d7f-9b59-38980f286b5c admin admin] PATH_INFO: `/v3/projects/1af09682be1f40aeb8049e0f9a8dc143/users/deecede409d74a98a99b195e7231d9ad/roles/40fb60241dc645059f308de1b41e6e44` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:28.653802 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2080f1-8e97-4d7f-9b59-38980f286b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af09682be1f40aeb8049e0f9a8dc143, user_id=deecede409d74a98a99b195e7231d9ad, role_id=40fb60241dc645059f308de1b41e6e44)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:28.656459 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2080f1-8e97-4d7f-9b59-38980f286b5c admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:28.671078 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 600/1190] 10.222.0.71 () {60 vars in 1483 bytes} [Wed Jul 27 19:21:28 2022] PUT /identity/v3/projects/1af09682be1f40aeb8049e0f9a8dc143/users/deecede409d74a98a99b195e7231d9ad/roles/40fb60241dc645059f308de1b41e6e44 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:21:35.483490 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:35.484101 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:35.484101 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:35.545081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] MFA Rules not processed for user `deecede409d74a98a99b195e7231d9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:35.547711 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:35.710948 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 591/1191] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:35 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:35.737384 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:35.738374 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:35.738658 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:35.741277 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:35.743190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:35.799917 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] MFA Rules not processed for user `d8d1c982df4641cb944a0f38185929e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:35.801817 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:35.862250 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:35.873789 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d1a61-cc57-49f9-a297-f820ed0cfb8d None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:35.879639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a92d0-9fcb-4e4e-91f0-57c1a150df6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0421ec636a1545329ad46308ef451145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:35.880572 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a92d0-9fcb-4e4e-91f0-57c1a150df6d service glance] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:35.880825 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a92d0-9fcb-4e4e-91f0-57c1a150df6d service glance] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:35.881106 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a92d0-9fcb-4e4e-91f0-57c1a150df6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:35.937093 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=100 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:36.012769 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a92d0-9fcb-4e4e-91f0-57c1a150df6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:36.015468 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a92d0-9fcb-4e4e-91f0-57c1a150df6d service glance] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:36.023571 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 601/1192] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:35 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:36.039243 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:36.042069 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:36.049071 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 592/1193] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:35 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:21:36.066686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0483cc-d97a-47d0-985c-efe15f993240 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:36.072840 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6edbf4-497c-4683-a47c-1d96f84a29d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0421ec636a1545329ad46308ef451145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:36.073489 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6edbf4-497c-4683-a47c-1d96f84a29d0 service glance] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:36.073993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6edbf4-497c-4683-a47c-1d96f84a29d0 service glance] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:36.074977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6edbf4-497c-4683-a47c-1d96f84a29d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:36.341226 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6edbf4-497c-4683-a47c-1d96f84a29d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:36.342586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6edbf4-497c-4683-a47c-1d96f84a29d0 service glance] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:36.362036 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 602/1194] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:36 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:21:45.435121 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa85e7-5c6d-4c22-8fd6-0108d892bd2b None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:45.435743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa85e7-5c6d-4c22-8fd6-0108d892bd2b None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:45.435743 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa85e7-5c6d-4c22-8fd6-0108d892bd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:45.465822 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-5eaa85e7-5c6d-4c22-8fd6-0108d892bd2b None None] MFA Rules not processed for user `f54bd75de20843fabd6b9f23b287529c`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:45.467119 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-5eaa85e7-5c6d-4c22-8fd6-0108d892bd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:45.477990 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 593/1195] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:21:45 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:45.887220 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8627e37-4d89-44a9-b030-9885b17538d7 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:45.887909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8627e37-4d89-44a9-b030-9885b17538d7 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:45.887909 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8627e37-4d89-44a9-b030-9885b17538d7 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:45.889365 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 603/1196] 10.222.0.71 () {54 vars in 962 bytes} [Wed Jul 27 19:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:21:45.900691 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19359a-2600-4e13-9cea-001453b76291 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:45.901049 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19359a-2600-4e13-9cea-001453b76291 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:45.901401 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19359a-2600-4e13-9cea-001453b76291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:45.982169 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-7f19359a-2600-4e13-9cea-001453b76291 None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:45.983419 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-7f19359a-2600-4e13-9cea-001453b76291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:46.059468 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 594/1197] 10.222.0.71 () {58 vars in 1059 bytes} [Wed Jul 27 19:21:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:46.064851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7576-f2be-48c1-be8d-5e2d7fad9849 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:46.065392 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7576-f2be-48c1-be8d-5e2d7fad9849 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:46.065802 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7576-f2be-48c1-be8d-5e2d7fad9849 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:46.067499 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 604/1198] 10.222.0.71 () {54 vars in 912 bytes} [Wed Jul 27 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:21:46.072744 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341b29-b524-4bd6-a8d2-ca9bd148b0db None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:46.073031 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341b29-b524-4bd6-a8d2-ca9bd148b0db None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:46.073305 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341b29-b524-4bd6-a8d2-ca9bd148b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:46.097134 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-cf341b29-b524-4bd6-a8d2-ca9bd148b0db None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:46.098370 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-cf341b29-b524-4bd6-a8d2-ca9bd148b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:46.107338 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 595/1199] 10.222.0.71 () {58 vars in 1009 bytes} [Wed Jul 27 19:21:46 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:46.120396 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7576-f2be-48c1-be8d-5e2d7fad9849 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:46.134197 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7576-f2be-48c1-be8d-5e2d7fad9849 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:46.138651 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bd0d5-5651-4bf5-8c20-796f7d8c9c0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0421ec636a1545329ad46308ef451145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:46.139436 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bd0d5-5651-4bf5-8c20-796f7d8c9c0d service glance] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:46.139727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bd0d5-5651-4bf5-8c20-796f7d8c9c0d service glance] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:46.140101 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bd0d5-5651-4bf5-8c20-796f7d8c9c0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:46.153922 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bd0d5-5651-4bf5-8c20-796f7d8c9c0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:46.155369 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bd0d5-5651-4bf5-8c20-796f7d8c9c0d service glance] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:46.170501 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 605/1200] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:46 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:21:46.755518 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc0e30-6acf-4654-a05e-f2544217115d None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:46.756176 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc0e30-6acf-4654-a05e-f2544217115d None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:46.756282 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc0e30-6acf-4654-a05e-f2544217115d None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:46.757717 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 596/1201] 10.222.0.71 () {54 vars in 912 bytes} [Wed Jul 27 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:21:46.763712 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b38d-9810-44f9-98aa-745ff33c0a88 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:46.764258 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b38d-9810-44f9-98aa-745ff33c0a88 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:46.764741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b38d-9810-44f9-98aa-745ff33c0a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:46.790184 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-5540b38d-9810-44f9-98aa-745ff33c0a88 None None] MFA Rules not processed for user `d6d1644bffa94434900353bf4a2fecea`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:46.791686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-5540b38d-9810-44f9-98aa-745ff33c0a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:46.850758 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 606/1202] 10.222.0.71 () {58 vars in 1009 bytes} [Wed Jul 27 19:21:46 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:46.863595 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc0e30-6acf-4654-a05e-f2544217115d None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:46.875990 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc0e30-6acf-4654-a05e-f2544217115d None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:46.879602 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4adb3-c0fa-4d23-80db-c5dc10333db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:46.880297 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4adb3-c0fa-4d23-80db-c5dc10333db3 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:46.880843 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4adb3-c0fa-4d23-80db-c5dc10333db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:46.881191 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4adb3-c0fa-4d23-80db-c5dc10333db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:46.892739 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4adb3-c0fa-4d23-80db-c5dc10333db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:46.894639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4adb3-c0fa-4d23-80db-c5dc10333db3 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:46.910265 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 597/1203] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:46 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:21:47.361580 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663602-22ef-4820-9396-ca662a1d0f03 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.362107 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663602-22ef-4820-9396-ca662a1d0f03 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.362206 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663602-22ef-4820-9396-ca662a1d0f03 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.363736 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 607/1204] 10.222.0.71 () {54 vars in 962 bytes} [Wed Jul 27 19:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:21:47.369266 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67ce1d-d235-42f8-85a2-51d5e25f2433 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.369552 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67ce1d-d235-42f8-85a2-51d5e25f2433 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.369855 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67ce1d-d235-42f8-85a2-51d5e25f2433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.381428 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d40805-7669-4e19-a27b-d5e706791425 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.381951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d40805-7669-4e19-a27b-d5e706791425 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.382386 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d40805-7669-4e19-a27b-d5e706791425 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.383874 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 608/1205] 10.222.0.71 () {54 vars in 961 bytes} [Wed Jul 27 19:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:21:47.389936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2145f-3d13-4281-8e0e-c8ec1c237cd3 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.391239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2145f-3d13-4281-8e0e-c8ec1c237cd3 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.391851 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2145f-3d13-4281-8e0e-c8ec1c237cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.392554 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-2a67ce1d-d235-42f8-85a2-51d5e25f2433 None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:47.393829 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-2a67ce1d-d235-42f8-85a2-51d5e25f2433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:47.403880 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 598/1206] 10.222.0.71 () {58 vars in 1059 bytes} [Wed Jul 27 19:21:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:21:47.410314 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f00a-b61e-41de-89fc-0a6803a05bb7 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.410600 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f00a-b61e-41de-89fc-0a6803a05bb7 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.411016 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f00a-b61e-41de-89fc-0a6803a05bb7 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.412438 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 599/1207] 10.222.0.71 () {54 vars in 912 bytes} [Wed Jul 27 19:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:21:47.415378 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-32c2145f-3d13-4281-8e0e-c8ec1c237cd3 None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:47.416664 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-32c2145f-3d13-4281-8e0e-c8ec1c237cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:47.420483 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a3d5-463f-4047-9cef-83071fbacb1a None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.421322 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a3d5-463f-4047-9cef-83071fbacb1a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.422174 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a3d5-463f-4047-9cef-83071fbacb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.443818 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-ce26a3d5-463f-4047-9cef-83071fbacb1a None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:47.445010 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-ce26a3d5-463f-4047-9cef-83071fbacb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:47.455142 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 600/1208] 10.222.0.71 () {58 vars in 1009 bytes} [Wed Jul 27 19:21:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:47.467060 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26a3d5-463f-4047-9cef-83071fbacb1a None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:47.472610 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=100 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:21:47.478641 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26a3d5-463f-4047-9cef-83071fbacb1a None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:47.483053 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f416e7-0798-408e-a6d8-069086ec59f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:47.483753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f416e7-0798-408e-a6d8-069086ec59f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.484475 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f416e7-0798-408e-a6d8-069086ec59f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.484756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f416e7-0798-408e-a6d8-069086ec59f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.491584 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 609/1209] 10.222.0.71 () {58 vars in 1058 bytes} [Wed Jul 27 19:21:47 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:21:47.495298 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f416e7-0798-408e-a6d8-069086ec59f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:47.497008 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f416e7-0798-408e-a6d8-069086ec59f1 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:47.500113 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2145f-3d13-4281-8e0e-c8ec1c237cd3 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:47.509080 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 601/1210] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:21:47.510405 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2145f-3d13-4281-8e0e-c8ec1c237cd3 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:47.516396 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:47.517050 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:47.517326 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:47.517597 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:47.519520 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:47.531951 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:47.533525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:47.543927 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 610/1211] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:47 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:21:56.597589 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e183-d850-4eb1-b8ee-121b5f72686a None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:56.598201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e183-d850-4eb1-b8ee-121b5f72686a None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:56.598201 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e183-d850-4eb1-b8ee-121b5f72686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:56.618103 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-c939e183-d850-4eb1-b8ee-121b5f72686a None None] MFA Rules not processed for user `d6d1644bffa94434900353bf4a2fecea`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:56.619328 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-c939e183-d850-4eb1-b8ee-121b5f72686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:56.627393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 602/1212] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jul 27 19:21:56 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:56.639092 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:56.649049 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c8bc1-3fa5-405e-8a2c-c44773095d61 service placement] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:56.653044 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139420a-01c3-4301-a14b-d4c890795706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:56.653899 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139420a-01c3-4301-a14b-d4c890795706 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:56.654176 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139420a-01c3-4301-a14b-d4c890795706 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:56.654471 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139420a-01c3-4301-a14b-d4c890795706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:56.661799 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139420a-01c3-4301-a14b-d4c890795706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:56.663241 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139420a-01c3-4301-a14b-d4c890795706 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:56.671589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 611/1213] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:56 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:21:57.657409 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dde2c-1b15-40ef-b116-7972647fadd6 None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:57.658033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dde2c-1b15-40ef-b116-7972647fadd6 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:57.658033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dde2c-1b15-40ef-b116-7972647fadd6 None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:57.659442 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 603/1214] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:21:57.678636 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d833a34-70f1-425b-a33f-418fc1e4cdd1 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:57.679208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d833a34-70f1-425b-a33f-418fc1e4cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:57.679208 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d833a34-70f1-425b-a33f-418fc1e4cdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:57.701800 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-6d833a34-70f1-425b-a33f-418fc1e4cdd1 None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:21:57.703695 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-6d833a34-70f1-425b-a33f-418fc1e4cdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:21:57.718368 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 612/1215] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:21:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:21:57.752238 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dde2c-1b15-40ef-b116-7972647fadd6 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:21:57.779314 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dde2c-1b15-40ef-b116-7972647fadd6 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:21:57.785566 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6db63-b802-41d9-bc71-587de9a0a96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:21:57.786232 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6db63-b802-41d9-bc71-587de9a0a96d service nova] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:21:57.786513 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6db63-b802-41d9-bc71-587de9a0a96d service nova] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:21:57.787020 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6db63-b802-41d9-bc71-587de9a0a96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:21:57.797308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6db63-b802-41d9-bc71-587de9a0a96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:21:57.798940 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6db63-b802-41d9-bc71-587de9a0a96d service nova] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:21:57.809144 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 604/1216] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:21:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:22:04.363241 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6104f-c00b-4a8e-afd8-ec1f61d64afc None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:22:04.363873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6104f-c00b-4a8e-afd8-ec1f61d64afc None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:22:04.363873 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6104f-c00b-4a8e-afd8-ec1f61d64afc None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:22:04.365148 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 613/1217] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:22:04.373639 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4124-4c44-4b86-89a2-9a1b3ee484ed None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:22:04.374269 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4124-4c44-4b86-89a2-9a1b3ee484ed None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:22:04.374420 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4124-4c44-4b86-89a2-9a1b3ee484ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:22:04.395489 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-f46a4124-4c44-4b86-89a2-9a1b3ee484ed None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:22:04.396738 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f46a4124-4c44-4b86-89a2-9a1b3ee484ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:22:04.406709 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 605/1218] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:22:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:22:04.427496 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6104f-c00b-4a8e-afd8-ec1f61d64afc None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:22:04.445395 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6104f-c00b-4a8e-afd8-ec1f61d64afc None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:22:04.452587 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5371371-704a-427d-bebc-0cd6963fb255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:22:04.453341 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5371371-704a-427d-bebc-0cd6963fb255 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:22:04.453795 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5371371-704a-427d-bebc-0cd6963fb255 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:22:04.454097 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5371371-704a-427d-bebc-0cd6963fb255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:22:04.465670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5371371-704a-427d-bebc-0cd6963fb255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:22:04.467925 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5371371-704a-427d-bebc-0cd6963fb255 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:22:04.481918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 614/1219] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:22:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:22:14.391667 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=82 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:22:14.476560 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=27 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:22:15.896300 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a4124-4c44-4b86-89a2-9a1b3ee484ed None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:22:15.907078 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a4124-4c44-4b86-89a2-9a1b3ee484ed None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:22:15.910895 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff910c6-c9c0-4a21-98f7-ad3f14c8a4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:22:15.911524 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff910c6-c9c0-4a21-98f7-ad3f14c8a4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:22:15.911810 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff910c6-c9c0-4a21-98f7-ad3f14c8a4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:22:15.912089 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff910c6-c9c0-4a21-98f7-ad3f14c8a4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:22:15.922494 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff910c6-c9c0-4a21-98f7-ad3f14c8a4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:22:15.923934 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff910c6-c9c0-4a21-98f7-ad3f14c8a4f6 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:22:15.943593 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 606/1220] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:22:15 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:22:25.933577 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=6 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:22:38.583993 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b2a3-5c9c-473c-b377-76b9a26aa4dd None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:22:38.584644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b2a3-5c9c-473c-b377-76b9a26aa4dd None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:22:38.584644 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b2a3-5c9c-473c-b377-76b9a26aa4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:22:38.604460 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-8a23b2a3-5c9c-473c-b377-76b9a26aa4dd None None] MFA Rules not processed for user `51d6a93d6269486197b7178cf1dc03f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:22:38.605727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-8a23b2a3-5c9c-473c-b377-76b9a26aa4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:22:38.613254 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 615/1221] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:22:38 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:22:48.599227 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:23:03.830711 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f76fc-58b1-41f8-b9d6-9ff038518bd2 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:23:03.831260 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f76fc-58b1-41f8-b9d6-9ff038518bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:23:03.831260 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f76fc-58b1-41f8-b9d6-9ff038518bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:23:03.851938 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-d93f76fc-58b1-41f8-b9d6-9ff038518bd2 None None] MFA Rules not processed for user `51d6a93d6269486197b7178cf1dc03f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:23:03.853389 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-d93f76fc-58b1-41f8-b9d6-9ff038518bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:23:03.860934 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 607/1222] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:23:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:23:04.283713 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83581-ba05-4c76-8612-7dab3f77c53f None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:23:04.284254 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83581-ba05-4c76-8612-7dab3f77c53f None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:23:04.284254 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83581-ba05-4c76-8612-7dab3f77c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:23:04.304045 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-2ab83581-ba05-4c76-8612-7dab3f77c53f None None] MFA Rules not processed for user `d6d1644bffa94434900353bf4a2fecea`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:23:04.305245 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-2ab83581-ba05-4c76-8612-7dab3f77c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:23:04.311669 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 616/1223] 10.222.0.71 () {58 vars in 1009 bytes} [Wed Jul 27 19:23:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:23:04.323033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f76fc-58b1-41f8-b9d6-9ff038518bd2 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:23:04.333049 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f76fc-58b1-41f8-b9d6-9ff038518bd2 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:23:04.336581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126873e-3813-486d-8b4f-c37bfa3f25c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:23:04.337190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126873e-3813-486d-8b4f-c37bfa3f25c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:23:04.337472 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126873e-3813-486d-8b4f-c37bfa3f25c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:23:04.337808 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126873e-3813-486d-8b4f-c37bfa3f25c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:23:04.345271 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126873e-3813-486d-8b4f-c37bfa3f25c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:23:04.346768 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126873e-3813-486d-8b4f-c37bfa3f25c4 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:23:04.354748 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 608/1224] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:23:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:23:14.299157 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:23:14.351087 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=9 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:23:18.925701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf111b-9827-4893-9f2a-806d3e383aec None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:23:18.926210 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf111b-9827-4893-9f2a-806d3e383aec None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:23:18.926313 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf111b-9827-4893-9f2a-806d3e383aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:23:18.946048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-51cf111b-9827-4893-9f2a-806d3e383aec None None] MFA Rules not processed for user `51d6a93d6269486197b7178cf1dc03f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:23:18.947239 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-51cf111b-9827-4893-9f2a-806d3e383aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:23:18.954001 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 617/1225] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:23:18 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:23:28.941065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=3 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:24:14.380029 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b698-db4d-4549-b74f-dc338eeb2142 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:24:14.380549 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b698-db4d-4549-b74f-dc338eeb2142 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:24:14.380549 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b698-db4d-4549-b74f-dc338eeb2142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:24:14.399125 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-0b24b698-db4d-4549-b74f-dc338eeb2142 None None] MFA Rules not processed for user `51d6a93d6269486197b7178cf1dc03f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:24:14.400316 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-0b24b698-db4d-4549-b74f-dc338eeb2142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:24:14.407137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 609/1226] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:24:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:24:24.394104 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=3 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:24:25.080572 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf111b-9827-4893-9f2a-806d3e383aec None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:24:25.100258 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf111b-9827-4893-9f2a-806d3e383aec None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:24:25.103825 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f491b-d622-42a3-bc73-f0c79cf1dd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:24:25.104432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f491b-d622-42a3-bc73-f0c79cf1dd00 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:24:25.104712 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f491b-d622-42a3-bc73-f0c79cf1dd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:24:25.104984 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f491b-d622-42a3-bc73-f0c79cf1dd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:24:25.114927 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f491b-d622-42a3-bc73-f0c79cf1dd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:24:25.116340 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f491b-d622-42a3-bc73-f0c79cf1dd00 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:24:25.126269 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 618/1227] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:24:25 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:24:35.122029 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=10 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:24:43.419687 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24b698-db4d-4549-b74f-dc338eeb2142 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:24:43.442449 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24b698-db4d-4549-b74f-dc338eeb2142 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:24:43.447568 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a0668-31b1-4bdc-8602-f3de2601c271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:24:43.448192 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a0668-31b1-4bdc-8602-f3de2601c271 service placement] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:24:43.448477 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a0668-31b1-4bdc-8602-f3de2601c271 service placement] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:24:43.448753 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a0668-31b1-4bdc-8602-f3de2601c271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:24:43.457987 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a0668-31b1-4bdc-8602-f3de2601c271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:24:43.459580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a0668-31b1-4bdc-8602-f3de2601c271 service placement] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:24:43.469499 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 610/1228] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:24:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:24:53.465286 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=10 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:25:58.360514 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a8bd1-484d-4e0d-9b3a-cc6e3345cbd1 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:25:58.360934 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a8bd1-484d-4e0d-9b3a-cc6e3345cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:25:58.361079 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a8bd1-484d-4e0d-9b3a-cc6e3345cbd1 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:25:58.362345 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 619/1229] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:25:58.369245 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3aa2-4691-400c-8e05-abdbdc4e4a4c None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:25:58.370160 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3aa2-4691-400c-8e05-abdbdc4e4a4c None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:25:58.370595 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3aa2-4691-400c-8e05-abdbdc4e4a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:25:58.423211 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-2b0f3aa2-4691-400c-8e05-abdbdc4e4a4c None None] MFA Rules not processed for user `059d420dbd794b8badd367bdb41ee2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:25:58.424441 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-2b0f3aa2-4691-400c-8e05-abdbdc4e4a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:25:58.445052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 611/1230] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:25:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:25:58.462438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a8bd1-484d-4e0d-9b3a-cc6e3345cbd1 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:25:58.479453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a8bd1-484d-4e0d-9b3a-cc6e3345cbd1 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:25:58.485274 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ee1e7-2ee8-4bc1-95e2-694f6585243e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:25:58.485932 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ee1e7-2ee8-4bc1-95e2-694f6585243e service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:25:58.486213 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ee1e7-2ee8-4bc1-95e2-694f6585243e service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:25:58.486484 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ee1e7-2ee8-4bc1-95e2-694f6585243e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:25:58.496984 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ee1e7-2ee8-4bc1-95e2-694f6585243e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:25:58.498638 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ee1e7-2ee8-4bc1-95e2-694f6585243e service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:25:58.511936 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 620/1231] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:25:58 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:26:08.440393 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=17 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:26:08.506340 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=6 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:26:11.956539 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e37d8c-1dd0-4eb5-937d-5bf4d597fd24 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:26:11.957043 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e37d8c-1dd0-4eb5-937d-5bf4d597fd24 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:26:11.957135 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e37d8c-1dd0-4eb5-937d-5bf4d597fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:26:11.976715 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-66e37d8c-1dd0-4eb5-937d-5bf4d597fd24 None None] MFA Rules not processed for user `f54bd75de20843fabd6b9f23b287529c`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:26:11.977941 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-66e37d8c-1dd0-4eb5-937d-5bf4d597fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:26:11.984706 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 612/1232] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:26:11 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:26:21.971339 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=3 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:26:35.427438 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896b26-32e6-4b3c-9780-c7a3d7036319 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:26:35.428027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896b26-32e6-4b3c-9780-c7a3d7036319 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:26:35.428027 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896b26-32e6-4b3c-9780-c7a3d7036319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:26:35.448641 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-d7896b26-32e6-4b3c-9780-c7a3d7036319 None None] MFA Rules not processed for user `51d6a93d6269486197b7178cf1dc03f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:26:35.449935 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-d7896b26-32e6-4b3c-9780-c7a3d7036319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:26:35.456801 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 621/1233] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:26:35 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:26:36.029245 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e37d8c-1dd0-4eb5-937d-5bf4d597fd24 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:26:36.091778 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e37d8c-1dd0-4eb5-937d-5bf4d597fd24 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:26:36.095425 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7605bd73b8204acba28a144a64d5eee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:26:36.096049 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:26:36.096333 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:26:36.096616 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:26:36.105632 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:26:36.107081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:26:36.115720 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 613/1234] 10.222.0.71 () {60 vars in 1396 bytes} [Wed Jul 27 19:26:36 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2806 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:26:36.267224 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896b26-32e6-4b3c-9780-c7a3d7036319 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:26:36.278238 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896b26-32e6-4b3c-9780-c7a3d7036319 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:26:36.281803 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7605bd73b8204acba28a144a64d5eee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:26:36.282425 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:26:36.282701 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:26:36.282972 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:26:36.292131 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:26:36.293586 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:26:36.304599 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 622/1235] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:26:36 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:26:46.111872 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=30 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:26:46.303302 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=9 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:26:47.092495 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:26:47.101705 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f4122-b813-4285-9df0-85fa05ebcf0f service cinder] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:26:47.105824 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:26:47.106432 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:26:47.106718 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:26:47.106993 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:26:47.116280 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:26:47.117745 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:26:47.129324 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 614/1236] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:26:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:26:48.307789 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:26:48.316806 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c83d-a0fe-4eaf-9fd3-6a4676514ba2 service cinder] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:26:48.320398 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:26:48.320994 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:26:48.321270 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:26:48.322158 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:26:48.331400 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:26:48.332794 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:26:48.343015 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 623/1237] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:26:48 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:26:57.124461 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=6 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:26:58.338724 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=6 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:27:04.930364 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:27:04.940075 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5d45e-f5d9-48e4-88e0-64edd5002309 service neutron] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:27:04.943697 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:27:04.944308 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:27:04.944649 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:27:04.945453 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:27:04.952976 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:27:04.954426 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:27:04.962932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 615/1238] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:27:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:27:14.959150 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=6 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:27:50.185969 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:27:50.213200 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4b15f-94b2-4740-8720-44614d206dd0 service neutron] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:27:50.222466 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31734bd-9093-465f-9b51-1c1e2f846494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:27:50.223290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31734bd-9093-465f-9b51-1c1e2f846494 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:27:50.223675 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31734bd-9093-465f-9b51-1c1e2f846494 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:27:50.224505 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31734bd-9093-465f-9b51-1c1e2f846494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:27:50.239057 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31734bd-9093-465f-9b51-1c1e2f846494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:27:50.241541 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31734bd-9093-465f-9b51-1c1e2f846494 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:27:50.261827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 624/1239] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:27:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:27:58.485962 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:27:58.494836 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1fea-0838-4902-8dac-44d7e40032e4 service neutron] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:27:58.498426 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24f96e-6c88-4b09-bb21-462de6ab5003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:27:58.499034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24f96e-6c88-4b09-bb21-462de6ab5003 service neutron] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:27:58.499313 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24f96e-6c88-4b09-bb21-462de6ab5003 service neutron] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:27:58.499604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24f96e-6c88-4b09-bb21-462de6ab5003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:27:58.563443 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24f96e-6c88-4b09-bb21-462de6ab5003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:27:58.565599 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24f96e-6c88-4b09-bb21-462de6ab5003 service neutron] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:27:58.584581 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 616/1240] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:27:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:28:00.255453 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=6 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:28:01.869265 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412f4c-fbe2-4299-b883-66e9c94dc895 None None] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:01.869988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412f4c-fbe2-4299-b883-66e9c94dc895 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:01.869988 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412f4c-fbe2-4299-b883-66e9c94dc895 None None] PATH_INFO: `/` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:01.871391 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 625/1241] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:28:01.900781 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3596-7491-4273-903b-2f10a5684dd0 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:01.901368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3596-7491-4273-903b-2f10a5684dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:01.901368 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3596-7491-4273-903b-2f10a5684dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:01.968687 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-141c3596-7491-4273-903b-2f10a5684dd0 None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:28:01.969956 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-141c3596-7491-4273-903b-2f10a5684dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:01.979331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 617/1242] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:28:01 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:28:01.991393 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412f4c-fbe2-4299-b883-66e9c94dc895 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:02.005170 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412f4c-fbe2-4299-b883-66e9c94dc895 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:02.010086 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a69af-603b-4d3d-bc4c-3a42b28fc3ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:02.010702 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a69af-603b-4d3d-bc4c-3a42b28fc3ab service placement] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:02.010981 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a69af-603b-4d3d-bc4c-3a42b28fc3ab service placement] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:02.011258 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a69af-603b-4d3d-bc4c-3a42b28fc3ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:02.020738 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a69af-603b-4d3d-bc4c-3a42b28fc3ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:02.022759 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a69af-603b-4d3d-bc4c-3a42b28fc3ab service placement] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:02.033827 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 626/1243] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:28:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:28:04.984069 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15094f9-6949-4b63-b151-d0c97e6e4ffa None None] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:04.984621 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15094f9-6949-4b63-b151-d0c97e6e4ffa None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:04.984750 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15094f9-6949-4b63-b151-d0c97e6e4ffa None None] PATH_INFO: `/` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:04.986256 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 618/1244] 10.222.0.71 () {54 vars in 921 bytes} [Wed Jul 27 19:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:28:05.013473 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2721-f7c2-4d87-bda2-7614de739992 None None] REQUEST_METHOD: `POST` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:05.014315 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2721-f7c2-4d87-bda2-7614de739992 None None] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:05.014315 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2721-f7c2-4d87-bda2-7614de739992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:05.038742 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.auth.core [None req-d43d2721-f7c2-4d87-bda2-7614de739992 None None] MFA Rules not processed for user `cf8e06cedc354cf9b5896752243693a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:28:05.040329 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-d43d2721-f7c2-4d87-bda2-7614de739992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:05.050084 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 627/1245] 10.222.0.71 () {58 vars in 1018 bytes} [Wed Jul 27 19:28:05 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:28:05.055331 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15094f9-6949-4b63-b151-d0c97e6e4ffa None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:05.070474 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15094f9-6949-4b63-b151-d0c97e6e4ffa None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:05.071918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d2721-f7c2-4d87-bda2-7614de739992 None None] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:05.080875 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:05.081546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:05.081923 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:05.082210 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] PATH_INFO: `/v3/users/f54bd75de20843fabd6b9f23b287529c` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:05.083431 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54bd75de20843fabd6b9f23b287529c)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:05.083812 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d2721-f7c2-4d87-bda2-7614de739992 None None] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:05.084456 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: WARNING py.warnings [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:28:05.084456 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: warnings.warn(msg) Jul 27 19:28:05.084456 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: Jul 27 19:28:05.086122 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:05.089598 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:05.090290 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:05.090574 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:05.090850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:05.101258 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:05.103418 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:05.114595 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 628/1246] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:28:05 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:28:05.167158 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54bd75de20843fabd6b9f23b287529c'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.175154 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54bd75de20843fabd6b9f23b287529c'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.193853 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54bd75de20843fabd6b9f23b287529c'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.203557 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54bd75de20843fabd6b9f23b287529c'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.204268 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54bd75de20843fabd6b9f23b287529c'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.211218 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 619/1247] 10.222.0.71 () {58 vars in 1224 bytes} [Wed Jul 27 19:28:05 2022] DELETE /identity/v3/users/f54bd75de20843fabd6b9f23b287529c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:28:05.399585 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:05.411565 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c29633-49a4-4735-af0d-493bbc1ddf54 service placement] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:05.469579 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:05.470314 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:05.470592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:05.470977 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] PATH_INFO: `/v3/projects/5c5239d52719427089e8c8ac88b17384` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:05.472130 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5239d52719427089e8c8ac88b17384)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:05.473137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: WARNING py.warnings [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:28:05.473137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: warnings.warn(msg) Jul 27 19:28:05.473137 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: Jul 27 19:28:05.474347 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:05.527931 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5239d52719427089e8c8ac88b17384', 'request_id': 'req-7571be26-ebf8-43de-9b7a-f7ddedfacb88'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.534372 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5239d52719427089e8c8ac88b17384', 'request_id': 'req-7571be26-ebf8-43de-9b7a-f7ddedfacb88'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.543163 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5239d52719427089e8c8ac88b17384', 'request_id': 'req-7571be26-ebf8-43de-9b7a-f7ddedfacb88'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.561749 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] The token cache is being invalidate because project 5c5239d52719427089e8c8ac88b17384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:28:05.562034 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.562670 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.564831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 629/1248] 10.222.0.71 () {58 vars in 1233 bytes} [Wed Jul 27 19:28:05 2022] DELETE /identity/v3/projects/5c5239d52719427089e8c8ac88b17384 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:28:05.568839 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:05.570371 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:05.584455 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc9a20-cf50-44e9-8d8b-ac9e4eccaab7 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:05.607901 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:28:05.644351 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:05.645267 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:05.645498 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:05.645853 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] PATH_INFO: `/v3/users/d8d1c982df4641cb944a0f38185929e0` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:05.647042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d1c982df4641cb944a0f38185929e0)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:05.648978 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:05.697460 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d1c982df4641cb944a0f38185929e0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.705034 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d1c982df4641cb944a0f38185929e0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.717052 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d1c982df4641cb944a0f38185929e0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.729033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d1c982df4641cb944a0f38185929e0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.729033 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-61c7e2c7-cb33-4949-88e0-d4930abc6b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d1c982df4641cb944a0f38185929e0'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:05.731762 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 620/1249] 10.222.0.71 () {58 vars in 1224 bytes} [Wed Jul 27 19:28:05 2022] DELETE /identity/v3/users/d8d1c982df4641cb944a0f38185929e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:28:05.905319 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:05.906808 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:05.919533 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571be26-ebf8-43de-9b7a-f7ddedfacb88 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:05.975432 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:28:05.982964 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:05.983623 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:05.984279 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:05.984592 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] PATH_INFO: `/v3/projects/4422c8c5086743df9f9a56ecc0be2539` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:05.986971 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4422c8c5086743df9f9a56ecc0be2539)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:05.989427 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:06.036794 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4422c8c5086743df9f9a56ecc0be2539', 'request_id': 'req-0cffe712-d813-423d-adf7-da0b865c2dfa'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:06.042154 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4422c8c5086743df9f9a56ecc0be2539', 'request_id': 'req-0cffe712-d813-423d-adf7-da0b865c2dfa'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:06.050585 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4422c8c5086743df9f9a56ecc0be2539', 'request_id': 'req-0cffe712-d813-423d-adf7-da0b865c2dfa'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:06.061530 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] The token cache is being invalidate because project 4422c8c5086743df9f9a56ecc0be2539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:28:06.061850 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:06.062479 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:28:06.064149 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 630/1250] 10.222.0.71 () {58 vars in 1233 bytes} [Wed Jul 27 19:28:05 2022] DELETE /identity/v3/projects/4422c8c5086743df9f9a56ecc0be2539 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:28:15.728040 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:28:16.058718 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:28:34.107953 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] REQUEST_METHOD: `POST` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:34.108487 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:34.108487 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:34.127765 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.auth.core [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] MFA Rules not processed for user `51d6a93d6269486197b7178cf1dc03f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:28:34.128980 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:34.183441 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 621/1251] 10.222.0.71 () {58 vars in 958 bytes} [Wed Jul 27 19:28:34 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:28:34.510793 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:34.512211 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:34.569272 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe712-d813-423d-adf7-da0b865c2dfa admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:34.572794 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:34.573402 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:34.573710 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:34.573986 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:34.575686 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:34.584862 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:34.586308 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:34.594043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 631/1252] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:28:34 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:28:35.043081 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:35.044582 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:35.124911 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd797d-a4a4-41c1-87ed-49b60d5cbb58 None None] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:35.130195 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:35.130807 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:35.131091 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:35.131358 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:35.133101 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:35.145943 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:35.147562 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:35.157270 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 622/1253] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:28:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:28:44.590741 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=26 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:28:44.640572 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:28:44.642020 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:44.717928 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9446f-d904-459f-847a-2270d7ba94d2 service neutron] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:28:44.722918 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '059d420dbd794b8badd367bdb41ee2d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:28:44.723539 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:28:44.723818 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:28:44.724241 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:28:44.726037 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:28:44.738746 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:28:44.740525 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:28:44.751629 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 632/1254] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:28:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:28:45.153247 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=57 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:28:54.747114 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=32 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:29:52.453784 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:29:52.455165 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:29:52.520546 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5e27f-6a67-45b3-ba22-36f51b4ff6a3 service placement] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:29:52.527404 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:29:52.528363 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:29:52.528759 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:29:52.529127 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:29:52.531424 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:29:52.542765 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:29:52.544465 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:29:52.553806 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 623/1255] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:29:52 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:30:02.549965 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=28 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:31:11.814612 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:31:11.816727 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:31:11.859444 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700c9d-e028-4523-b6d4-4510d32da195 service nova] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:31:11.863043 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6d1644bffa94434900353bf4a2fecea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:31:11.863657 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] REQUEST_METHOD: `GET` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:31:11.863938 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:31:11.864213 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:31:11.865978 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:31:11.950183 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:31:11.951602 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:31:11.961550 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 633/1256] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:31:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:31:18.442925 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:31:18.444932 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:31:18.460239 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f0ca9-1d71-4f14-8b15-4e6a532fa78d service placement] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:31:18.465570 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:31:18.466579 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:31:18.466864 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:31:18.467137 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] PATH_INFO: `/v3/users/51d6a93d6269486197b7178cf1dc03f1` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:31:18.468441 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d6a93d6269486197b7178cf1dc03f1)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:31:18.470448 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:31:18.523186 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d6a93d6269486197b7178cf1dc03f1'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.531813 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d6a93d6269486197b7178cf1dc03f1'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.545192 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d6a93d6269486197b7178cf1dc03f1'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.554878 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d6a93d6269486197b7178cf1dc03f1'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.555604 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d6a93d6269486197b7178cf1dc03f1'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.561569 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 624/1257] 10.222.0.71 () {58 vars in 1224 bytes} [Wed Jul 27 19:31:18 2022] DELETE /identity/v3/users/51d6a93d6269486197b7178cf1dc03f1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:31:18.736979 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:31:18.748928 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c7d44-e160-4012-8987-7c47350e100d service neutron] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:31:18.814067 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:31:18.814647 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:31:18.815515 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:31:18.815792 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] PATH_INFO: `/v3/projects/c1cc865b98d64f6ca27cb77c69ee5877` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:31:18.816928 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1cc865b98d64f6ca27cb77c69ee5877)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:31:18.818831 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:31:18.864048 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:31:18.865531 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1cc865b98d64f6ca27cb77c69ee5877', 'request_id': 'req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.872846 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1cc865b98d64f6ca27cb77c69ee5877', 'request_id': 'req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.880221 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1cc865b98d64f6ca27cb77c69ee5877', 'request_id': 'req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.893288 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] The token cache is being invalidate because project c1cc865b98d64f6ca27cb77c69ee5877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:31:18.893589 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.894327 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:18.896144 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 634/1258] 10.222.0.71 () {58 vars in 1233 bytes} [Wed Jul 27 19:31:18 2022] DELETE /identity/v3/projects/c1cc865b98d64f6ca27cb77c69ee5877 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:31:18.899935 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:31:18.901302 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:31:18.914906 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7a924-1be4-4f9d-af37-e304ad6e2df6 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:31:18.970642 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:31:18.971344 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:31:18.971756 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:31:18.972042 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] PATH_INFO: `/v3/users/deecede409d74a98a99b195e7231d9ad` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:31:18.973200 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deecede409d74a98a99b195e7231d9ad)` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:31:18.975190 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:31:19.021297 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deecede409d74a98a99b195e7231d9ad'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.028379 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deecede409d74a98a99b195e7231d9ad'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.040478 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deecede409d74a98a99b195e7231d9ad'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.042415 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:31:19.048585 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deecede409d74a98a99b195e7231d9ad'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.049694 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.notifications [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deecede409d74a98a99b195e7231d9ad'} {{(pid=87167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.056394 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 625/1259] 10.222.0.71 () {58 vars in 1224 bytes} [Wed Jul 27 19:31:18 2022] DELETE /identity/v3/users/deecede409d74a98a99b195e7231d9ad => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:31:19.234753 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Authenticating user token {{(pid=87166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:31:19.236261 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.fernet_utils [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:31:19.250364 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ffd09-2bbe-46a9-8b93-e9df4ecf3032 admin admin] Validating token access rules against request {{(pid=87166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:31:19.309065 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9411e66c17864f3a88f0f7077545cca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bac04fe952a4d2c91db90416fe41f28', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:31:19.309887 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:31:19.310175 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:31:19.310455 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] PATH_INFO: `/v3/projects/1af09682be1f40aeb8049e0f9a8dc143` {{(pid=87166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:31:19.311613 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af09682be1f40aeb8049e0f9a8dc143)` {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:31:19.313563 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] RBAC: Authorization granted {{(pid=87166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:31:19.360455 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af09682be1f40aeb8049e0f9a8dc143', 'request_id': 'req-8b7bebe5-a355-471b-8f16-28900f957af8'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.365948 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af09682be1f40aeb8049e0f9a8dc143', 'request_id': 'req-8b7bebe5-a355-471b-8f16-28900f957af8'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.373883 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af09682be1f40aeb8049e0f9a8dc143', 'request_id': 'req-8b7bebe5-a355-471b-8f16-28900f957af8'} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.385346 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] The token cache is being invalidate because project 1af09682be1f40aeb8049e0f9a8dc143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:31:19.385632 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.386276 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG keystone.notifications [None req-8b7bebe5-a355-471b-8f16-28900f957af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:31:19.387796 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: [pid: 87166|app: 0|req: 635/1260] 10.222.0.71 () {58 vars in 1233 bytes} [Wed Jul 27 19:31:19 2022] DELETE /identity/v3/projects/1af09682be1f40aeb8049e0f9a8dc143 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:31:29.053580 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=4 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:31:29.382332 dv-osbrick-849020-4-ceph devstack@keystone.service[87166]: DEBUG dbcounter [-] [87166] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:34:55.429611 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Authenticating user token {{(pid=87167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:34:55.431078 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:34:55.509376 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c5232-72e6-4aed-9fca-faa01e6faf33 admin admin] Validating token access rules against request {{(pid=87167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:34:55.568462 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436be3d-886f-4cf8-8b3d-1167d77899b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8e06cedc354cf9b5896752243693a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '074f3318a4b34aac85f631b95f159c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:34:55.569105 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436be3d-886f-4cf8-8b3d-1167d77899b9 service placement] REQUEST_METHOD: `GET` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:34:55.569387 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436be3d-886f-4cf8-8b3d-1167d77899b9 service placement] SCRIPT_NAME: `/identity` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:34:55.569690 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436be3d-886f-4cf8-8b3d-1167d77899b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:34:55.571599 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.fernet_utils [None req-7436be3d-886f-4cf8-8b3d-1167d77899b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:34:55.583818 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436be3d-886f-4cf8-8b3d-1167d77899b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:34:55.585948 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436be3d-886f-4cf8-8b3d-1167d77899b9 service placement] RBAC: Authorization granted {{(pid=87167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:34:55.595566 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: [pid: 87167|app: 0|req: 626/1261] 10.222.0.71 () {60 vars in 1365 bytes} [Wed Jul 27 19:34:55 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:35:05.591565 dv-osbrick-849020-4-ceph devstack@keystone.service[87167]: DEBUG dbcounter [-] [87167] Writing DB stats keystone:SELECT=62 {{(pid=87167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}